2024-09-13T17:06:13.178 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T17:06:13.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:06:13.282 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879 branch: wip-rishabh-testing-20240910.100730-reef description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} email: null first_in_suite: false job_id: '7903879' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client acl type: posix_acl client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+gkCYj5RBp6JZk63sE519jbx497sfBC1Za82waoINOeblSEV50Yr5glLJNmMSnUfa47hAmOul0vAqCgFcujAo= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSSRHXIakytNkBqzQmK3Ciw6O+Exof5PKBfHBxnIVgmZJz2/frrHOOE/8MoKaIDLoGILT+vxwVsYSyCzK8copE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - fs/misc/acl.sh - fs/misc/chmod.sh - fs/misc/dac_override.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T17:06:13.282 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T17:06:13.283 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T17:06:13.283 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T17:06:13.285 INFO:teuthology.task.internal:Checking packages... 2024-09-13T17:06:13.303 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T17:06:13.303 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T17:06:13.303 INFO:teuthology.packaging:ref: None 2024-09-13T17:06:13.303 INFO:teuthology.packaging:tag: None 2024-09-13T17:06:13.304 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:06:13.304 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:06:13.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:06:13.453 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:06:13.454 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T17:06:13.463 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T17:06:13.464 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T17:06:13.492 INFO:teuthology.task.internal:Saving configuration 2024-09-13T17:06:13.507 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T17:06:13.519 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T17:06:13.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:00:21.097555', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINzKSO2X0CHMt+5KcDEbEZoxf70e4pSBkZV1MX1fUv9h'} 2024-09-13T17:06:13.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:00:21.099144', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJpcfyFWggvflBS+4j8xMx9VFd8pI8yN7PICMQexKZ+F'} 2024-09-13T17:06:13.580 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T17:06:13.591 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-13T17:06:13.591 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-13T17:06:13.592 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T17:06:13.671 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe32fc43be0>, signals=[15]) 2024-09-13T17:06:13.671 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T17:06:13.682 INFO:teuthology.task.internal:Opening connections... 2024-09-13T17:06:13.682 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:06:13.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:06:13.777 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:06:13.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:06:13.879 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T17:06:13.888 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-13T17:06:13.893 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-13T17:06:13.894 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="22.04" 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=jammy 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2024-09-13T17:06:13.942 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:06:13.943 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:06:13.943 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:06:13.943 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:06:13.943 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=jammy 2024-09-13T17:06:13.943 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-13T17:06:13.974 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-09-13T17:06:13.980 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-09-13T17:06:13.980 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2024-09-13T17:06:14.026 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:06:14.027 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:06:14.027 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:06:14.027 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:06:14.027 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2024-09-13T17:06:14.027 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-09-13T17:06:14.058 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T17:06:14.069 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T17:06:14.081 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T17:06:14.081 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:06:14.084 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:06:14.089 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T17:06:14.099 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T17:06:14.099 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:06:14.131 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:06:14.149 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T17:06:14.230 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T17:06:14.246 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T17:06:14.246 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T17:06:14.246 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:06:14.247 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:06:14.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:14.251 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-13T17:06:14.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:14.252 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-09-13T17:06:14.298 INFO:teuthology.orchestra.run.smithi167.stdout:5.15.0-56-generic 2024-09-13T17:06:14.298 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.15.0-56-generic 2024-09-13T17:06:14.298 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get clean 2024-09-13T17:06:14.299 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-56-generic 2024-09-13T17:06:14.299 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.15.0-56-generic 2024-09-13T17:06:14.300 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-09-13T17:06:14.417 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2024-09-13T17:06:14.449 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-13T17:06:14.560 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:06:14.572 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T17:06:14.609 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:06:14.609 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T17:06:14.609 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T17:06:14.637 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T17:06:14.665 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T17:06:14.671 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T17:06:14.792 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T17:06:14.857 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T17:06:14.890 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T17:06:14.895 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T17:06:14.897 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T17:06:14.897 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T17:06:14.898 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T17:06:14.917 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T17:06:14.920 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T17:06:14.920 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T17:06:14.921 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T17:06:14.928 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T17:06:14.928 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T17:06:14.933 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T17:06:14.935 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T17:06:14.935 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T17:06:14.935 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T17:06:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T17:06:14.953 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T17:06:14.954 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T17:06:14.954 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T17:06:14.955 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T17:06:14.955 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T17:06:14.969 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T17:06:14.972 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T17:06:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T17:06:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T17:06:14.973 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T17:06:14.973 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T17:06:14.973 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T17:06:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T17:06:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T17:06:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T17:06:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T17:06:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T17:06:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T17:06:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T17:06:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T17:06:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T17:06:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T17:06:15.021 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T17:06:15.021 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T17:06:15.024 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T17:06:15.024 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T17:06:15.024 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T17:06:15.041 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T17:06:15.041 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T17:06:15.044 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T17:06:15.044 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T17:06:15.049 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T17:06:15.056 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T17:06:15.057 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T17:06:15.058 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T17:06:15.058 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T17:06:15.074 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T17:06:15.075 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T17:06:15.075 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T17:06:15.075 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T17:06:15.075 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T17:06:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T17:06:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T17:06:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T17:06:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T17:06:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T17:06:15.101 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T17:06:15.524 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T17:06:15.541 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T17:06:15.549 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T17:06:15.550 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T17:06:15.551 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T17:06:15.648 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T17:06:15.659 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T17:06:15.659 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T17:06:15.678 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T17:06:15.704 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T17:06:15.708 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T17:06:15.710 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T17:06:15.711 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T17:06:15.712 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T17:06:15.791 INFO:teuthology.orchestra.run.smithi167.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T17:06:21.320 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 16.0 MB in 2s (7,473 kB/s) 2024-09-13T17:06:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 16.0 MB in 2s (7,414 kB/s) 2024-09-13T17:06:22.708 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-13T17:06:22.725 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:06:22.776 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-13T17:06:22.858 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-13T17:06:22.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:06:22.930 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-13T17:06:22.962 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-13T17:06:22.962 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-13T17:06:23.116 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-09-13T17:06:23.117 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-09-13T17:06:23.130 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:06:23.130 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:06:23.130 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:06:23.131 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:06:23.131 INFO:teuthology.orchestra.run.smithi190.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T17:06:23.131 INFO:teuthology.orchestra.run.smithi190.stdout: python2.7-minimal 2024-09-13T17:06:23.131 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:06:23.133 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-13T17:06:23.133 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T17:06:23.133 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T17:06:23.133 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T17:06:23.135 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-13T17:06:23.135 INFO:teuthology.orchestra.run.smithi190.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T17:06:23.135 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-09-13T17:06:23.135 INFO:teuthology.orchestra.run.smithi190.stdout: thermald 2024-09-13T17:06:23.183 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-13T17:06:23.183 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T17:06:23.183 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T17:06:23.184 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T17:06:23.185 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2024-09-13T17:06:23.186 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T17:06:23.238 INFO:teuthology.orchestra.run.smithi190.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T17:06:23.238 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 113 MB of archives. 2024-09-13T17:06:23.238 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T17:06:23.238 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T17:06:23.282 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:06:23.282 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:06:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:06:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:06:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T17:06:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: python2.7-minimal 2024-09-13T17:06:23.283 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:06:23.284 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2024-09-13T17:06:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T17:06:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T17:06:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T17:06:23.286 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2024-09-13T17:06:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T17:06:23.286 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2024-09-13T17:06:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: thermald 2024-09-13T17:06:23.330 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2024-09-13T17:06:23.330 INFO:teuthology.orchestra.run.smithi167.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T17:06:23.330 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T17:06:23.330 INFO:teuthology.orchestra.run.smithi167.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T17:06:23.332 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages will be upgraded: 2024-09-13T17:06:23.332 INFO:teuthology.orchestra.run.smithi167.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T17:06:23.383 INFO:teuthology.orchestra.run.smithi167.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T17:06:23.383 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 113 MB of archives. 2024-09-13T17:06:23.384 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T17:06:23.384 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T17:06:23.696 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T17:06:23.788 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T17:06:23.792 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T17:06:23.873 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T17:06:24.587 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T17:06:24.587 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T17:06:24.587 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T17:06:24.669 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T17:06:24.669 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T17:06:24.670 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T17:06:24.708 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T17:06:24.796 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T17:06:24.812 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T17:06:24.896 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T17:06:25.213 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 113 MB in 2s (70.0 MB/s) 2024-09-13T17:06:25.290 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 113 MB in 2s (72.8 MB/s) 2024-09-13T17:06:25.398 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T17:06:25.487 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T17:06:27.404 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T17:06:27.408 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:27.535 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T17:06:27.540 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:27.695 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:27.810 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:29.888 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T17:06:29.908 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:29.995 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:30.054 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T17:06:30.075 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:30.153 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:30.440 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T17:06:30.460 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:30.497 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:30.607 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T17:06:30.628 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:30.657 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:37.311 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T17:06:37.418 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T17:06:37.455 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T17:06:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T17:06:37.779 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T17:06:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T17:06:37.917 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T17:06:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T17:06:38.220 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T17:06:38.242 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T17:06:38.303 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T17:06:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T17:06:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T17:06:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T17:06:44.354 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T17:06:44.390 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:44.411 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T17:06:44.428 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:44.448 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T17:06:44.486 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:47.106 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T17:06:47.133 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T17:06:47.232 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T17:06:47.283 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T17:06:47.582 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T17:06:47.617 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T17:06:47.679 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:47.738 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:47.779 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T17:06:47.848 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T17:06:47.933 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:47.976 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:49.262 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:06:49.262 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T17:06:49.262 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T17:06:49.262 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T17:06:49.329 INFO:teuthology.orchestra.run.smithi167.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:06:49.329 INFO:teuthology.orchestra.run.smithi167.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T17:06:49.329 INFO:teuthology.orchestra.run.smithi167.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T17:06:49.329 INFO:teuthology.orchestra.run.smithi167.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T17:06:49.427 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:49.505 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:51.129 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:51.331 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:52.480 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T17:06:52.606 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T17:06:52.691 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T17:06:52.765 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:52.816 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T17:06:52.835 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T17:06:52.835 INFO:teuthology.orchestra.run.smithi190.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T17:06:52.951 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T17:06:53.028 INFO:teuthology.orchestra.run.smithi167.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T17:06:53.028 INFO:teuthology.orchestra.run.smithi167.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T17:07:07.092 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T17:07:07.092 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub' 2024-09-13T17:07:07.120 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:07:07.146 INFO:teuthology.orchestra.run.smithi190.stdout:Generating grub configuration file ... 2024-09-13T17:07:07.338 INFO:teuthology.orchestra.run.smithi167.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T17:07:07.338 INFO:teuthology.orchestra.run.smithi167.stdout:Sourcing file `/etc/default/grub' 2024-09-13T17:07:07.370 INFO:teuthology.orchestra.run.smithi167.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:07:07.392 INFO:teuthology.orchestra.run.smithi167.stdout:Generating grub configuration file ... 2024-09-13T17:07:07.436 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T17:07:07.458 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T17:07:07.737 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:07:07.745 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:07:07.775 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T17:07:07.792 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T17:07:07.812 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:07:07.818 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:07:07.986 INFO:teuthology.orchestra.run.smithi190.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:07:07.986 INFO:teuthology.orchestra.run.smithi190.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:07:07.986 INFO:teuthology.orchestra.run.smithi190.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:07:08.046 INFO:teuthology.orchestra.run.smithi190.stdout:done 2024-09-13T17:07:08.196 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:07:08.203 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:07:08.271 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:07:08.277 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:07:08.455 INFO:teuthology.orchestra.run.smithi167.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:07:08.455 INFO:teuthology.orchestra.run.smithi167.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:07:08.455 INFO:teuthology.orchestra.run.smithi167.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:07:08.497 INFO:teuthology.orchestra.run.smithi167.stdout:done 2024-09-13T17:07:08.545 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.121.121 2024-09-13T17:07:08.566 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T17:07:08.567 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:07:08.567 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-09-13T17:07:08.567 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-09-13T17:07:08.567 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:07:08.567 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-09-13T17:07:08.567 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T17:07:08.567 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T17:07:08.567 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T17:07:08.568 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T17:07:08.568 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T17:07:08.568 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-09-13T17:07:08.728 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-13T17:07:08.880 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T17:07:08.970 DEBUG:teuthology.orchestra.run.smithi167:> dpkg -s linux-image-generic 2024-09-13T17:07:08.982 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Package: linux-image-generic 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Status: install ok installed 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Priority: optional 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Section: kernel 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Installed-Size: 21 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: amd64 2024-09-13T17:07:08.990 INFO:teuthology.orchestra.run.smithi167.stdout:Source: linux-meta 2024-09-13T17:07:08.991 INFO:teuthology.orchestra.run.smithi167.stdout:Version: 5.15.0.121.121 2024-09-13T17:07:08.991 INFO:teuthology.orchestra.run.smithi167.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T17:07:08.991 INFO:teuthology.orchestra.run.smithi167.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:07:08.991 INFO:teuthology.orchestra.run.smithi167.stdout:Recommends: thermald 2024-09-13T17:07:08.991 INFO:teuthology.orchestra.run.smithi167.stdout:Description: Generic Linux kernel image 2024-09-13T17:07:08.991 INFO:teuthology.orchestra.run.smithi167.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:07:08.991 INFO:teuthology.orchestra.run.smithi167.stdout: available. 2024-09-13T17:07:08.991 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T17:07:08.991 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T17:07:08.991 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T17:07:08.992 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T17:07:08.992 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T17:07:08.992 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get clean 2024-09-13T17:07:09.063 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T17:07:09.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2024-09-13T17:07:09.145 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T17:07:09.389 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:07:09.389 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T17:07:09.454 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T17:07:09.536 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T17:07:10.372 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-13T17:07:10.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:07:10.452 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-13T17:07:10.661 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-13T17:07:10.661 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-13T17:07:10.845 INFO:teuthology.orchestra.run.smithi190.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T17:07:10.845 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:07:10.845 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:07:10.845 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:07:10.845 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:07:10.846 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:07:10.846 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:07:10.846 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:07:10.862 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-13T17:07:10.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:07:10.884 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T17:07:10.886 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-09-13T17:07:10.902 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.121.121 2024-09-13T17:07:10.903 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T17:07:10.903 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:07:10.903 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-09-13T17:07:10.903 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-09-13T17:07:10.903 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:07:10.903 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-09-13T17:07:10.903 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-09-13T17:07:10.945 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-13T17:07:10.949 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.8DS9N6HBSo 2024-09-13T17:07:10.949 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub/grub.cfg /tmp/tmp.8DS9N6HBSo 2024-09-13T17:07:11.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.8DS9N6HBSo 2024-09-13T17:07:11.131 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.8DS9N6HBSo is 10KB 2024-09-13T17:07:11.145 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.8DS9N6HBSo 2024-09-13T17:07:11.150 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T17:07:11.161 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-09-13T17:07:11.161 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-09-13T17:07:11.206 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:07:11.206 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T17:07:11.206 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T17:07:11.276 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T17:07:11.276 DEBUG:teuthology.orchestra.run.smithi190:> sudo update-grub 2024-09-13T17:07:11.354 INFO:teuthology.orchestra.run.smithi167.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T17:07:11.354 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:07:11.354 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:07:11.354 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:07:11.355 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:07:11.355 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:07:11.355 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:07:11.355 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:07:11.396 INFO:teuthology.orchestra.run.smithi167.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T17:07:11.398 DEBUG:teuthology.orchestra.run.smithi167:> dpkg -s linux-image-generic 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Package: linux-image-generic 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Status: install ok installed 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Priority: optional 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Section: kernel 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Installed-Size: 21 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: amd64 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Source: linux-meta 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Version: 5.15.0.121.121 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T17:07:11.414 INFO:teuthology.orchestra.run.smithi167.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:07:11.415 INFO:teuthology.orchestra.run.smithi167.stdout:Recommends: thermald 2024-09-13T17:07:11.415 INFO:teuthology.orchestra.run.smithi167.stdout:Description: Generic Linux kernel image 2024-09-13T17:07:11.415 INFO:teuthology.orchestra.run.smithi167.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:07:11.415 INFO:teuthology.orchestra.run.smithi167.stdout: available. 2024-09-13T17:07:11.415 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-13T17:07:11.461 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.vKaLCNH1MJ 2024-09-13T17:07:11.462 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vKaLCNH1MJ 2024-09-13T17:07:11.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.vKaLCNH1MJ 2024-09-13T17:07:11.638 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.vKaLCNH1MJ is 10KB 2024-09-13T17:07:11.651 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.vKaLCNH1MJ 2024-09-13T17:07:11.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T17:07:11.709 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:07:11.709 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T17:07:11.709 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T17:07:11.775 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T17:07:11.776 DEBUG:teuthology.orchestra.run.smithi167:> sudo update-grub 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:07:12.557 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:07:12.559 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2024-09-13T17:07:12.823 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T17:07:12.828 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T17:07:13.065 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:07:13.070 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:07:13.092 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:07:13.093 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:07:13.097 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-13T17:07:13.111 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:07:13.117 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:07:13.254 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:07:13.254 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:07:13.254 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:07:13.256 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T17:07:13.264 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T17:07:13.280 INFO:teuthology.orchestra.run.smithi190.stderr:done 2024-09-13T17:07:13.282 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2024-09-13T17:07:13.585 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:07:13.591 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:07:13.632 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:07:13.637 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:07:13.751 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:07:13.751 INFO:teuthology.orchestra.run.smithi167.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:07:13.751 INFO:teuthology.orchestra.run.smithi167.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:07:13.762 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-13T17:07:13.764 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-13T17:07:43.313 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T17:07:43.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-13T17:07:43.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:07:43.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T17:07:43.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-13T17:07:43.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:08:01.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-09-13T17:08:02.237 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-13T17:08:10.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-13T17:08:10.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:08:11.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-13T17:08:11.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:08:13.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-09-13T17:08:14.301 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-13T17:08:25.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-13T17:08:25.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:08:26.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-13T17:08:26.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:08:57.573 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-09-13T17:08:58.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-13T17:08:58.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-13T17:08:58.464 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-09-13T17:08:58.509 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-121-generic 2024-09-13T17:08:58.509 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T17:08:58.510 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:08:58.510 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:08:59.510 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T17:08:59.510 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T17:08:59.596 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2024-09-13T17:08:59.626 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:26.313 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T17:09:41.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-13T17:09:41.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:09:41.543 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-13T17:09:42.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-13T17:09:42.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T17:09:42.067 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-13T17:09:42.113 INFO:teuthology.orchestra.run.smithi167.stdout:5.15.0-121-generic 2024-09-13T17:09:42.113 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T17:09:42.113 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:09:42.113 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:09:43.115 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T17:09:43.115 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T17:09:43.472 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-09-13T17:09:43.495 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:43.496 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T17:09:43.503 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T17:09:43.504 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:09:43.506 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:09:43.512 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T17:09:43.519 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T17:09:43.528 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T17:09:43.528 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:09:43.554 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:09:43.575 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T17:09:43.581 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T17:09:43.582 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:09:43.615 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:09:43.636 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:09:43.646 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:09:43.649 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:09:43.657 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:09:43.658 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T17:09:43.665 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T17:09:43.665 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:09:43.690 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:09:43.726 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T17:09:43.736 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T17:09:43.736 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:09:43.746 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:09:43.772 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:09:43.800 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:09:43.846 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:09:43.846 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:09:43.918 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:09:43.924 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:09:43.973 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:09:43.973 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:09:44.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-13T17:09:44.043 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-09-13T17:09:44.120 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T17:09:44.127 INFO:teuthology.task.internal:Starting timer... 2024-09-13T17:09:44.127 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T17:09:44.143 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T17:09:44.154 DEBUG:teuthology.task.selinux:Excluding smithi167: OS 'ubuntu' does not support SELinux 2024-09-13T17:09:44.154 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2024-09-13T17:09:44.154 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T17:09:44.154 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T17:09:44.155 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T17:09:44.155 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T17:09:44.164 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T17:09:44.175 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T17:09:44.176 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi167.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T17:17:09.917 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi167.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-09-13T17:17:09.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-13T17:17:09.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:17:10.026 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-13T17:17:10.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-13T17:17:10.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-13T17:17:10.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:17:10.210 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-09-13T17:17:10.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-13T17:17:10.289 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T17:17:10.299 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T17:17:10.299 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:17:10.300 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:17:10.302 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:17:10.302 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:17:10.328 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T17:17:10.328 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Command line: ntpd -gq 2024-09-13T17:17:10.329 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: ---------------------------------------------------- 2024-09-13T17:17:10.329 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T17:17:10.329 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T17:17:10.329 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: corporation. Support and training for ntp-4 are 2024-09-13T17:17:10.329 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: available at https://www.nwtime.org/support 2024-09-13T17:17:10.329 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: ---------------------------------------------------- 2024-09-13T17:17:10.329 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: proto: precision = 0.045 usec (-24) 2024-09-13T17:17:10.330 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: basedate set to 2022-02-04 2024-09-13T17:17:10.330 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: gps base set to 2022-02-06 (week 2196) 2024-09-13T17:17:10.330 INFO:teuthology.orchestra.run.smithi167.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:17:10.330 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:17:10.330 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:17:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:17:10.331 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:17:10.331 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:17:10.331 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:17:10.332 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Listen normally on 3 enp3s0f1 172.21.15.167:123 2024-09-13T17:17:10.332 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Listen normally on 4 lo [::1]:123 2024-09-13T17:17:10.332 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7309%5]:123 2024-09-13T17:17:10.332 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:10 ntpd[18465]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:17:10.360 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T17:17:10.360 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Command line: ntpd -gq 2024-09-13T17:17:10.361 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: ---------------------------------------------------- 2024-09-13T17:17:10.361 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T17:17:10.361 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T17:17:10.361 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: corporation. Support and training for ntp-4 are 2024-09-13T17:17:10.361 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: available at https://www.nwtime.org/support 2024-09-13T17:17:10.361 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: ---------------------------------------------------- 2024-09-13T17:17:10.362 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: proto: precision = 0.045 usec (-24) 2024-09-13T17:17:10.362 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: basedate set to 2022-02-04 2024-09-13T17:17:10.362 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: gps base set to 2022-02-06 (week 2196) 2024-09-13T17:17:10.362 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:17:10.362 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:17:10.362 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:17:10.363 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:17:10.363 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:17:10.363 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:17:10.364 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:17:10.364 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2024-09-13T17:17:10.364 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Listen normally on 4 lo [::1]:123 2024-09-13T17:17:10.364 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2024-09-13T17:17:10.364 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:10 ntpd[18500]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:17:11.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:11.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:11.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:11.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:11 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:11.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:11 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:11.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:11 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:11.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:11 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:11.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:11 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:11.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:11 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:11.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:11 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:12.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:12.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:12 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:12.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:12.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:12 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:12.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:12.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:12 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:12.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:12 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:12.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:12 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:12.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:12 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:12.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:12 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:12.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:12 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:12.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:12 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:13.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:13 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:13.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:13 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:14.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:14.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:14.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:14 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:14.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:14.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:14 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:14.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:14.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:14 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:14.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:14.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:14 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:15.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:15 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:15.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:15.363 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:15.363 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:15 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:16 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:16 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:16 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:16 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:16 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:16.331 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:16 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:16.361 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:16.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:16.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:16.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:16.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:16.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:16 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:17.329 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stdout:13 Sep 17:17:17 ntpd[18465]: ntpd: time slew +0.000992 s 2024-09-13T17:17:17.330 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd: time slew +0.000992s 2024-09-13T17:17:17.331 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:17:17.331 INFO:teuthology.orchestra.run.smithi167.stderr:13 Sep 17:17:17 ntpd[18465]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:17:17.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:17.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:17.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:17.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:17.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:17.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:17.362 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:17.363 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:17.363 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:17:17.363 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:17:17.363 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:17:17.363 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:17:17.363 INFO:teuthology.orchestra.run.smithi190.stdout:13 Sep 17:17:17 ntpd[18500]: ntpd: time slew -0.001354 s 2024-09-13T17:17:17.363 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew -0.001354s 2024-09-13T17:17:17.364 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:17:17.364 INFO:teuthology.orchestra.run.smithi190.stderr:13 Sep 17:17:17 ntpd[18500]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:17:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:17:17.404 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2024-09-13T17:17:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.468 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:17:17.468 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-09-13T17:17:17.468 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.468 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.469 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.469 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:17:17.469 INFO:teuthology.run_tasks:Running task install... 2024-09-13T17:17:17.477 DEBUG:teuthology.task.install:project ceph 2024-09-13T17:17:17.477 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T17:17:17.477 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T17:17:17.477 INFO:teuthology.task.install:Using flavor: default 2024-09-13T17:17:17.482 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T17:17:17.482 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T17:17:17.483 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-key list | grep Ceph 2024-09-13T17:17:17.483 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2024-09-13T17:17:17.539 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T17:17:17.566 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:17:17.566 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:17:17.566 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:17:17.566 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:17:17.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:17:17.579 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T17:17:17.599 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:17:17.599 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:17:17.600 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:17:17.600 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:17:17.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:17:17.740 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default/ 2024-09-13T17:17:17.740 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:17:17.754 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default/ 2024-09-13T17:17:17.754 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:17:17.951 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:17:17.951 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:17:17.953 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:17:17.953 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:17:17.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2024-09-13T17:17:17.968 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-13T17:17:18.133 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:17:18.137 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:17:18.144 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T17:17:18.148 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T17:17:18.223 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T17:17:18.225 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T17:17:18.273 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T17:17:18.274 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T17:17:18.277 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T17:17:18.277 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T17:17:18.351 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T17:17:18.351 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T17:17:18.402 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T17:17:18.402 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T17:17:18.454 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-09-13T17:17:18.455 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T17:17:18.497 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T17:17:18.502 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-09-13T17:17:18.728 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 413 kB in 1s (722 kB/s) 2024-09-13T17:17:18.730 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 413 kB in 1s (727 kB/s) 2024-09-13T17:17:19.786 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-13T17:17:19.789 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-13T17:17:19.803 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1jammy cephadm=18.2.4-860-g6c6b083f-1jammy ceph-mds=18.2.4-860-g6c6b083f-1jammy ceph-mgr=18.2.4-860-g6c6b083f-1jammy ceph-common=18.2.4-860-g6c6b083f-1jammy ceph-fuse=18.2.4-860-g6c6b083f-1jammy ceph-test=18.2.4-860-g6c6b083f-1jammy ceph-volume=18.2.4-860-g6c6b083f-1jammy radosgw=18.2.4-860-g6c6b083f-1jammy python3-rados=18.2.4-860-g6c6b083f-1jammy python3-rgw=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy python3-rbd=18.2.4-860-g6c6b083f-1jammy libcephfs2=18.2.4-860-g6c6b083f-1jammy libcephfs-dev=18.2.4-860-g6c6b083f-1jammy librados2=18.2.4-860-g6c6b083f-1jammy librbd1=18.2.4-860-g6c6b083f-1jammy rbd-fuse=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy cephfs-shell=18.2.4-860-g6c6b083f-1jammy cephfs-top=18.2.4-860-g6c6b083f-1jammy cephfs-mirror=18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:17:19.806 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1jammy cephadm=18.2.4-860-g6c6b083f-1jammy ceph-mds=18.2.4-860-g6c6b083f-1jammy ceph-mgr=18.2.4-860-g6c6b083f-1jammy ceph-common=18.2.4-860-g6c6b083f-1jammy ceph-fuse=18.2.4-860-g6c6b083f-1jammy ceph-test=18.2.4-860-g6c6b083f-1jammy ceph-volume=18.2.4-860-g6c6b083f-1jammy radosgw=18.2.4-860-g6c6b083f-1jammy python3-rados=18.2.4-860-g6c6b083f-1jammy python3-rgw=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy python3-rbd=18.2.4-860-g6c6b083f-1jammy libcephfs2=18.2.4-860-g6c6b083f-1jammy libcephfs-dev=18.2.4-860-g6c6b083f-1jammy librados2=18.2.4-860-g6c6b083f-1jammy librbd1=18.2.4-860-g6c6b083f-1jammy rbd-fuse=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy cephfs-shell=18.2.4-860-g6c6b083f-1jammy cephfs-top=18.2.4-860-g6c6b083f-1jammy cephfs-mirror=18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:17:19.858 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-13T17:17:19.874 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-13T17:17:20.053 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-09-13T17:17:20.053 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-09-13T17:17:20.094 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-13T17:17:20.095 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-13T17:17:20.238 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:17:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:17:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:17:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:17:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:17:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:17:20.239 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:17:20.240 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2024-09-13T17:17:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:17:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T17:17:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:17:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:17:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T17:17:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T17:17:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T17:17:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T17:17:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T17:17:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-watchdog 2024-09-13T17:17:20.243 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2024-09-13T17:17:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: btrfs-tools 2024-09-13T17:17:20.312 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:17:20.313 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:17:20.313 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:17:20.313 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:17:20.313 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:17:20.313 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:17:20.313 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:17:20.314 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-13T17:17:20.314 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:17:20.314 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T17:17:20.315 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:17:20.315 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T17:17:20.315 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:17:20.316 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-13T17:17:20.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout: python3-watchdog 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-09-13T17:17:20.318 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2024-09-13T17:17:20.352 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2024-09-13T17:17:20.352 INFO:teuthology.orchestra.run.smithi167.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:17:20.352 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:17:20.352 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:17:20.353 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T17:17:20.353 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:17:20.353 INFO:teuthology.orchestra.run.smithi167.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T17:17:20.353 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T17:17:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T17:17:20.355 INFO:teuthology.orchestra.run.smithi167.stdout: socat xmlstarlet 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T17:17:20.425 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T17:17:20.426 INFO:teuthology.orchestra.run.smithi190.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T17:17:20.426 INFO:teuthology.orchestra.run.smithi190.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T17:17:20.426 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T17:17:20.427 INFO:teuthology.orchestra.run.smithi190.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T17:17:20.428 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T17:17:20.428 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T17:17:20.428 INFO:teuthology.orchestra.run.smithi190.stdout: socat xmlstarlet 2024-09-13T17:17:20.485 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 115 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T17:17:20.485 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 163 MB of archives. 2024-09-13T17:17:20.485 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 748 MB of additional disk space will be used. 2024-09-13T17:17:20.486 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T17:17:20.503 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T17:17:20.513 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T17:17:20.543 INFO:teuthology.orchestra.run.smithi167.stdout:0 upgraded, 115 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T17:17:20.543 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 163 MB of archives. 2024-09-13T17:17:20.544 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 748 MB of additional disk space will be used. 2024-09-13T17:17:20.544 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T17:17:20.554 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T17:17:20.560 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1jammy [3,453 kB] 2024-09-13T17:17:20.563 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T17:17:20.579 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T17:17:20.582 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T17:17:20.592 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T17:17:20.625 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T17:17:20.638 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T17:17:20.641 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T17:17:20.652 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T17:17:20.656 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T17:17:20.656 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T17:17:20.664 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T17:17:20.665 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T17:17:20.665 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T17:17:20.666 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T17:17:20.667 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T17:17:20.671 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T17:17:20.675 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T17:17:20.676 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T17:17:20.676 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T17:17:20.681 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1jammy [3,453 kB] 2024-09-13T17:17:20.692 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T17:17:20.693 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T17:17:20.695 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T17:17:20.696 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T17:17:20.696 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T17:17:20.697 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T17:17:20.698 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:17:20.710 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T17:17:20.710 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T17:17:20.711 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T17:17:20.727 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T17:17:20.727 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T17:17:20.732 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T17:17:20.732 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T17:17:20.733 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T17:17:20.733 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T17:17:20.744 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T17:17:20.745 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T17:17:20.746 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T17:17:20.761 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T17:17:20.764 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T17:17:20.764 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T17:17:20.765 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T17:17:20.767 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T17:17:20.818 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T17:17:20.818 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T17:17:20.820 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T17:17:20.820 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T17:17:20.821 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T17:17:20.831 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T17:17:20.831 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T17:17:20.833 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:17:20.833 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T17:17:20.836 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T17:17:20.855 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T17:17:20.856 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T17:17:20.856 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T17:17:20.867 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T17:17:20.872 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T17:17:20.872 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T17:17:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T17:17:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T17:17:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T17:17:20.874 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T17:17:20.874 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T17:17:20.890 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T17:17:20.893 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T17:17:20.904 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T17:17:20.907 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T17:17:20.908 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T17:17:20.909 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T17:17:20.912 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T17:17:20.914 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T17:17:20.915 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T17:17:20.918 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T17:17:20.921 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:17:20.924 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T17:17:20.925 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T17:17:20.941 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T17:17:20.942 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T17:17:20.942 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T17:17:20.978 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T17:17:20.989 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T17:17:21.032 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T17:17:21.197 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T17:17:21.205 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T17:17:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T17:17:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T17:17:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T17:17:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T17:17:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T17:17:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T17:17:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T17:17:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T17:17:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T17:17:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T17:17:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T17:17:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T17:17:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T17:17:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T17:17:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T17:17:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T17:17:21.442 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:17:21.443 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T17:17:21.443 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T17:17:21.446 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T17:17:21.447 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T17:17:21.448 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T17:17:21.457 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1jammy [3,108 kB] 2024-09-13T17:17:21.524 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T17:17:21.524 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T17:17:21.525 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T17:17:21.526 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T17:17:21.605 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T17:17:21.609 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T17:17:21.610 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T17:17:21.613 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T17:17:21.614 INFO:teuthology.orchestra.run.smithi167.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T17:17:21.619 INFO:teuthology.orchestra.run.smithi167.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T17:17:21.630 INFO:teuthology.orchestra.run.smithi167.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1jammy [684 kB] 2024-09-13T17:17:21.634 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1jammy [3,108 kB] 2024-09-13T17:17:21.667 INFO:teuthology.orchestra.run.smithi167.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1jammy [357 kB] 2024-09-13T17:17:21.685 INFO:teuthology.orchestra.run.smithi167.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1jammy [32.8 kB] 2024-09-13T17:17:21.686 INFO:teuthology.orchestra.run.smithi167.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T17:17:21.686 INFO:teuthology.orchestra.run.smithi167.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1jammy [180 kB] 2024-09-13T17:17:21.688 INFO:teuthology.orchestra.run.smithi167.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T17:17:21.690 INFO:teuthology.orchestra.run.smithi167.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1jammy [63.7 kB] 2024-09-13T17:17:21.692 INFO:teuthology.orchestra.run.smithi167.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1jammy [334 kB] 2024-09-13T17:17:21.693 INFO:teuthology.orchestra.run.smithi167.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T17:17:21.709 INFO:teuthology.orchestra.run.smithi167.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1jammy [5,933 kB] 2024-09-13T17:17:21.855 INFO:teuthology.orchestra.run.smithi167.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T17:17:21.857 INFO:teuthology.orchestra.run.smithi167.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T17:17:21.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T17:17:21.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T17:17:21.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T17:17:21.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T17:17:21.879 INFO:teuthology.orchestra.run.smithi167.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T17:17:21.883 INFO:teuthology.orchestra.run.smithi167.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:17:21.883 INFO:teuthology.orchestra.run.smithi167.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T17:17:21.904 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1jammy [684 kB] 2024-09-13T17:17:21.940 INFO:teuthology.orchestra.run.smithi167.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T17:17:21.942 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1jammy [357 kB] 2024-09-13T17:17:21.974 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1jammy [32.8 kB] 2024-09-13T17:17:21.975 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1jammy [180 kB] 2024-09-13T17:17:21.985 INFO:teuthology.orchestra.run.smithi167.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T17:17:21.985 INFO:teuthology.orchestra.run.smithi167.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1jammy [112 kB] 2024-09-13T17:17:21.988 INFO:teuthology.orchestra.run.smithi167.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1jammy [445 kB] 2024-09-13T17:17:21.989 INFO:teuthology.orchestra.run.smithi167.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T17:17:21.990 INFO:teuthology.orchestra.run.smithi167.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T17:17:22.014 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1jammy [63.7 kB] 2024-09-13T17:17:22.016 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1jammy [334 kB] 2024-09-13T17:17:22.024 INFO:teuthology.orchestra.run.smithi167.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1jammy [22.1 MB] 2024-09-13T17:17:22.041 INFO:teuthology.orchestra.run.smithi167.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T17:17:22.041 INFO:teuthology.orchestra.run.smithi167.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T17:17:22.042 INFO:teuthology.orchestra.run.smithi167.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T17:17:22.043 INFO:teuthology.orchestra.run.smithi167.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T17:17:22.043 INFO:teuthology.orchestra.run.smithi167.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T17:17:22.044 INFO:teuthology.orchestra.run.smithi167.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T17:17:22.090 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1jammy [5,933 kB] 2024-09-13T17:17:22.104 INFO:teuthology.orchestra.run.smithi167.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T17:17:22.105 INFO:teuthology.orchestra.run.smithi167.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T17:17:22.111 INFO:teuthology.orchestra.run.smithi167.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T17:17:22.186 INFO:teuthology.orchestra.run.smithi167.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T17:17:22.189 INFO:teuthology.orchestra.run.smithi167.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T17:17:22.190 INFO:teuthology.orchestra.run.smithi167.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T17:17:22.198 INFO:teuthology.orchestra.run.smithi167.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T17:17:22.204 INFO:teuthology.orchestra.run.smithi167.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T17:17:22.204 INFO:teuthology.orchestra.run.smithi167.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T17:17:22.214 INFO:teuthology.orchestra.run.smithi167.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T17:17:22.267 INFO:teuthology.orchestra.run.smithi167.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:17:22.268 INFO:teuthology.orchestra.run.smithi167.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T17:17:22.272 INFO:teuthology.orchestra.run.smithi167.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T17:17:22.349 INFO:teuthology.orchestra.run.smithi167.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T17:17:22.349 INFO:teuthology.orchestra.run.smithi167.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T17:17:22.351 INFO:teuthology.orchestra.run.smithi167.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T17:17:22.575 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1jammy [112 kB] 2024-09-13T17:17:22.578 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1jammy [445 kB] 2024-09-13T17:17:22.588 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1jammy [22.1 MB] 2024-09-13T17:17:24.016 INFO:teuthology.orchestra.run.smithi167.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1jammy [5,006 kB] 2024-09-13T17:17:24.279 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1jammy [5,006 kB] 2024-09-13T17:17:24.388 INFO:teuthology.orchestra.run.smithi167.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1jammy [242 kB] 2024-09-13T17:17:24.393 INFO:teuthology.orchestra.run.smithi167.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1jammy [130 kB] 2024-09-13T17:17:24.396 INFO:teuthology.orchestra.run.smithi167.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1jammy [1,496 kB] 2024-09-13T17:17:24.527 INFO:teuthology.orchestra.run.smithi167.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1jammy [6,085 kB] 2024-09-13T17:17:24.549 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1jammy [242 kB] 2024-09-13T17:17:24.555 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1jammy [130 kB] 2024-09-13T17:17:24.558 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1jammy [1,496 kB] 2024-09-13T17:17:24.683 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1jammy [6,085 kB] 2024-09-13T17:17:25.068 INFO:teuthology.orchestra.run.smithi167.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1jammy [22.4 MB] 2024-09-13T17:17:25.113 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1jammy [22.4 MB] 2024-09-13T17:17:26.911 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1jammy [14.2 kB] 2024-09-13T17:17:26.911 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1jammy [835 kB] 2024-09-13T17:17:26.927 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1jammy [2,159 kB] 2024-09-13T17:17:26.969 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1jammy [240 kB] 2024-09-13T17:17:26.970 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1jammy [145 kB] 2024-09-13T17:17:26.972 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1jammy [2,233 kB] 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1jammy [8,625 kB] 2024-09-13T17:17:27.089 INFO:teuthology.orchestra.run.smithi167.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1jammy [14.2 kB] 2024-09-13T17:17:27.090 INFO:teuthology.orchestra.run.smithi167.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1jammy [835 kB] 2024-09-13T17:17:27.107 INFO:teuthology.orchestra.run.smithi167.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1jammy [2,159 kB] 2024-09-13T17:17:27.289 INFO:teuthology.orchestra.run.smithi167.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1jammy [240 kB] 2024-09-13T17:17:27.294 INFO:teuthology.orchestra.run.smithi167.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1jammy [145 kB] 2024-09-13T17:17:27.298 INFO:teuthology.orchestra.run.smithi167.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1jammy [2,233 kB] 2024-09-13T17:17:27.509 INFO:teuthology.orchestra.run.smithi167.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1jammy [8,625 kB] 2024-09-13T17:17:27.636 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1jammy [14.3 kB] 2024-09-13T17:17:27.637 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1jammy [42.9 MB] 2024-09-13T17:17:28.303 INFO:teuthology.orchestra.run.smithi167.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1jammy [14.3 kB] 2024-09-13T17:17:28.349 INFO:teuthology.orchestra.run.smithi167.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1jammy [42.9 MB] 2024-09-13T17:17:30.749 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1jammy [122 kB] 2024-09-13T17:17:30.752 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1jammy [233 kB] 2024-09-13T17:17:30.757 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1jammy [34.0 kB] 2024-09-13T17:17:30.758 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1jammy [23.5 kB] 2024-09-13T17:17:30.759 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1jammy [38.3 kB] 2024-09-13T17:17:30.760 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1jammy [11.7 MB] 2024-09-13T17:17:31.374 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1jammy [93.0 kB] 2024-09-13T17:17:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1jammy [122 kB] 2024-09-13T17:17:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1jammy [233 kB] 2024-09-13T17:17:31.834 INFO:teuthology.orchestra.run.smithi167.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1jammy [34.0 kB] 2024-09-13T17:17:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1jammy [23.5 kB] 2024-09-13T17:17:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1jammy [38.3 kB] 2024-09-13T17:17:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1jammy [11.7 MB] 2024-09-13T17:17:31.946 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 163 MB in 11s (14.9 MB/s) 2024-09-13T17:17:32.087 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:17:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T17:17:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1jammy [93.0 kB] 2024-09-13T17:17:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T17:17:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T17:17:32.530 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:17:32.557 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T17:17:32.597 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:17:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 163 MB in 12s (13.8 MB/s) 2024-09-13T17:17:32.941 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:17:32.968 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T17:17:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:17:33.008 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T17:17:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T17:17:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T17:17:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T17:17:33.327 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T17:17:33.354 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T17:17:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:17:33.436 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:17:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T17:17:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:17:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:17:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T17:17:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T17:17:33.939 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T17:17:33.965 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T17:17:34.005 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:17:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T17:17:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T17:17:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:17:34.333 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:17:34.360 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T17:17:34.400 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:17:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T17:17:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T17:17:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:17:34.719 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:17:34.746 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T17:17:34.786 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:17:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:17:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T17:17:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:17:35.173 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:17:35.200 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:17:35.239 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:17:35.408 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:17:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T17:17:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:17:35.626 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:17:35.652 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:17:35.692 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:17:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:17:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:17:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:17:36.004 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:17:36.029 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:17:36.062 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:17:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:17:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:17:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:17:36.423 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T17:17:36.450 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T17:17:36.490 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:17:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:17:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:17:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:17:36.809 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2. 2024-09-13T17:17:36.836 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:36.876 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T17:17:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T17:17:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:17:37.311 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1. 2024-09-13T17:17:37.338 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-librbd1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:37.378 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librados2. 2024-09-13T17:17:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:37.773 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:17:37.799 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:37.831 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librbd1. 2024-09-13T17:17:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../012-librbd1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:38.116 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:17:38.132 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-python3-rados_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:38.175 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:38.494 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:17:38.520 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:17:38.561 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:17:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:17:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../014-python3-rados_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:39.089 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:17:39.104 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:39.147 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:17:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:17:39.383 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:17:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:39.409 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:17:39.449 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:17:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:39.769 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:17:39.796 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T17:17:39.836 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T17:17:39.940 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:17:39.966 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:17:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:40.122 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:17:40.137 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:40.180 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:17:40.352 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T17:17:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T17:17:40.516 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:17:40.531 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T17:17:40.566 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:17:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:17:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:40.885 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:17:40.912 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-librgw2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:40.952 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:17:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T17:17:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:17:41.376 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:17:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../021-librgw2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:41.437 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:17:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:41.453 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:41.496 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:41.798 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T17:17:41.825 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T17:17:41.865 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:17:41.970 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:17:41.996 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:42.037 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:42.109 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:17:42.125 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:42.168 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:42.364 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T17:17:42.391 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T17:17:42.431 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:17:42.587 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:17:42.614 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-ceph-common_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:42.662 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:42.692 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:17:42.707 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:42.742 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:43.162 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:17:43.188 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../025-ceph-common_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:43.229 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:43.943 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:17:43.969 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-ceph-base_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:44.152 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:44.543 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:17:44.569 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../026-ceph-base_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:44.619 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:44.713 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T17:17:44.729 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T17:17:44.763 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:17:45.008 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T17:17:45.023 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T17:17:45.066 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:17:45.188 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T17:17:45.214 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T17:17:45.255 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:17:45.360 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T17:17:45.387 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T17:17:45.427 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:17:45.516 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T17:17:45.543 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T17:17:45.574 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:17:45.730 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T17:17:45.757 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T17:17:45.797 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:17:45.845 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T17:17:45.871 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T17:17:45.911 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:17:46.099 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T17:17:46.126 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T17:17:46.166 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:17:46.216 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T17:17:46.240 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T17:17:46.280 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:17:46.410 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T17:17:46.437 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T17:17:46.468 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T17:17:46.583 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T17:17:46.609 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T17:17:46.650 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:17:46.765 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-portend. 2024-09-13T17:17:46.792 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T17:17:46.832 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T17:17:46.937 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T17:17:46.969 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T17:17:47.159 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T17:17:47.186 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T17:17:47.226 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T17:17:47.272 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-portend. 2024-09-13T17:17:47.298 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T17:17:47.338 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T17:17:47.478 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:17:47.505 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T17:17:47.545 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:17:47.641 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T17:17:47.668 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T17:17:47.708 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T17:17:47.874 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:17:47.900 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T17:17:47.940 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T17:17:47.986 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:17:48.012 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T17:17:48.044 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:17:48.226 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:17:48.252 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T17:17:48.293 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T17:17:48.406 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:17:48.433 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T17:17:48.473 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T17:17:48.587 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:17:48.613 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T17:17:48.654 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:17:48.809 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:17:48.835 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T17:17:48.876 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T17:17:48.948 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:17:48.975 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T17:17:49.015 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:17:49.187 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:17:49.214 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T17:17:49.256 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:17:49.510 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:17:49.536 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:17:49.665 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:17:49.680 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T17:17:49.714 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:17:49.879 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:17:49.905 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T17:17:49.945 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:17:50.018 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:17:50.033 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:17:50.076 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:17:50.232 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:17:50.258 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:17:50.387 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:17:50.414 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T17:17:50.454 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:17:50.619 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T17:17:50.671 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:17:50.748 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:17:50.775 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T17:17:50.815 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:17:50.962 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:17:50.989 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T17:17:51.028 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:17:51.101 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:17:51.117 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T17:17:51.154 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:17:51.331 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:17:51.357 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T17:17:51.398 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:17:51.463 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:17:51.489 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T17:17:51.529 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:17:51.718 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:17:51.733 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T17:17:51.776 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:17:51.832 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:17:51.859 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T17:17:51.898 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:17:52.053 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:17:52.079 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T17:17:52.120 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:17:52.193 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:17:52.220 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T17:17:52.260 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:17:52.423 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:17:52.449 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T17:17:52.498 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T17:17:52.605 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:17:52.631 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T17:17:52.671 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:17:52.801 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:17:52.827 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T17:17:52.859 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:17:52.974 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:17:53.000 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T17:17:53.040 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T17:17:53.188 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T17:17:53.204 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T17:17:53.238 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T17:17:53.319 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:17:53.345 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T17:17:53.635 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:17:54.350 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-idna. 2024-09-13T17:17:54.377 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T17:17:54.417 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:17:54.515 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T17:17:54.541 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T17:17:54.573 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T17:17:54.728 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T17:17:54.754 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T17:17:54.794 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:17:54.876 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-idna. 2024-09-13T17:17:54.903 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T17:17:54.943 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:17:55.114 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests. 2024-09-13T17:17:55.140 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T17:17:55.180 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:17:55.246 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T17:17:55.272 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T17:17:55.312 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:17:55.492 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:17:55.518 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T17:17:55.558 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:17:55.632 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests. 2024-09-13T17:17:55.659 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T17:17:55.699 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:17:55.844 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:17:55.871 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:17:55.911 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:56.035 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:17:56.061 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T17:17:56.101 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:17:56.257 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:17:56.284 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:56.324 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:56.405 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:17:56.432 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:17:56.471 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:56.610 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:17:56.637 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T17:17:56.676 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:17:56.835 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:17:56.861 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:56.901 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:56.996 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:17:57.023 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T17:17:57.062 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T17:17:57.204 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:17:57.230 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T17:17:57.279 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:17:57.390 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:17:57.417 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:57.465 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:57.581 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:17:57.608 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T17:17:57.648 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T17:17:57.810 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:17:57.837 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:57.876 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:57.934 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:17:57.961 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:57.992 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:58.371 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:17:58.397 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:58.437 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:58.505 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:17:58.532 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:58.571 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:59.041 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:17:59.068 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:59.107 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:17:59.808 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2024-09-13T17:17:59.835 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:17:59.874 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:00.118 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:18:00.134 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:00.168 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:00.185 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph. 2024-09-13T17:18:00.201 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../062-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:00.235 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:00.538 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:18:00.539 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:18:00.565 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:00.565 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:00.605 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:00.605 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:00.967 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:18:00.993 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:01.000 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:18:01.027 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-cephadm_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:01.033 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:01.066 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:01.344 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:18:01.371 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T17:18:01.394 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:18:01.402 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T17:18:01.421 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../065-cephadm_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:01.461 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:01.730 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T17:18:01.739 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:18:01.745 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:18:01.765 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T17:18:01.780 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:01.805 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T17:18:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T17:18:02.107 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:18:02.141 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:02.752 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-babel. 2024-09-13T17:18:02.779 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:18:02.818 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:03.138 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T17:18:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-babel. 2024-09-13T17:18:03.204 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:18:03.207 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:18:03.247 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:03.541 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:18:03.567 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:18:03.568 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:03.593 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T17:18:03.607 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:03.633 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:18:03.944 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:18:03.971 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T17:18:03.978 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:18:04.005 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:04.011 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:18:04.044 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:04.322 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:18:04.349 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T17:18:04.388 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T17:18:04.406 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:18:04.433 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T17:18:04.473 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:18:04.742 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T17:18:04.742 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:18:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T17:18:04.769 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T17:18:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T17:18:04.808 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T17:18:05.096 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T17:18:05.111 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-toml. 2024-09-13T17:18:05.123 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T17:18:05.138 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T17:18:05.154 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T17:18:05.169 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-toml. 2024-09-13T17:18:05.472 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:18:05.475 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T17:18:05.499 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T17:18:05.515 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T17:18:05.538 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:18:05.818 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:18:05.845 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T17:18:05.875 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:18:05.884 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:18:05.902 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:18:05.942 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:18:06.191 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:18:06.195 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:18:06.217 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:18:06.221 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T17:18:06.257 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:18:06.261 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:18:06.539 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:18:06.552 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:18:06.566 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:06.578 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T17:18:06.597 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:06.618 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:18:06.980 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:18:06.995 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:07.038 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:07.769 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T17:18:07.785 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T17:18:07.827 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:18:08.277 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T17:18:08.304 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T17:18:08.314 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:18:08.341 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T17:18:08.343 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:18:08.380 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:18:08.759 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T17:18:08.786 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T17:18:08.814 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:18:08.841 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T17:18:08.842 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:18:08.880 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:18:09.153 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:18:09.181 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T17:18:09.217 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T17:18:09.219 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:18:09.244 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T17:18:09.284 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:18:09.553 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:18:09.581 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T17:18:09.620 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:18:09.971 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:18:09.999 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:10.038 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:10.572 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:18:10.600 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:10.630 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:11.183 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:18:11.211 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T17:18:11.249 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T17:18:11.552 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:18:11.580 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T17:18:11.617 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:18:11.618 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:18:11.644 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T17:18:11.684 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T17:18:11.947 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:18:11.974 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T17:18:11.987 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:18:12.013 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:18:12.014 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T17:18:12.053 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:18:12.325 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:18:12.352 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T17:18:12.399 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:18:12.416 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T17:18:12.426 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T17:18:12.465 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:18:12.737 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:18:12.751 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:18:12.763 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T17:18:12.767 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T17:18:12.803 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T17:18:12.810 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T17:18:13.080 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:18:13.089 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:18:13.107 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T17:18:13.117 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T17:18:13.138 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T17:18:13.147 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:18:13.425 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:18:13.452 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T17:18:13.467 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:18:13.494 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T17:18:13.534 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T17:18:13.803 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:18:13.873 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T17:18:13.886 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T17:18:13.911 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:18:14.198 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:18:14.225 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T17:18:14.264 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:18:14.550 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:18:14.567 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:14.608 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:14.928 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:18:14.955 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T17:18:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:18:15.070 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:18:15.086 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:15.120 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:15.297 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:18:15.324 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:18:15.355 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T17:18:15.482 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:18:15.600 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2024-09-13T17:18:15.627 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:18:15.666 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T17:18:15.835 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:18:15.863 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:18:15.901 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:18:15.919 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2024-09-13T17:18:15.946 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T17:18:16.002 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:18:16.129 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package jq. 2024-09-13T17:18:16.145 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:18:16.179 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T17:18:16.297 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:18:16.324 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T17:18:16.363 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:18:16.398 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package socat. 2024-09-13T17:18:16.414 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T17:18:16.457 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:18:16.726 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:18:16.752 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:18:16.753 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-ceph-test_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:16.779 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T17:18:16.792 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:16.818 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:18:17.173 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:18:17.189 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../098-ceph-test_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:17.231 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:18.663 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:18:18.691 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:18.729 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:19.109 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:19.169 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:18:19.175 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:19.196 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:19.235 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:19.495 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:18:19.522 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T17:18:19.578 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T17:18:19.581 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:18:19.609 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:19.648 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:19.942 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:18:19.943 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:18:19.966 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:19.970 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T17:18:20.005 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:20.009 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T17:18:20.233 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:18:20.249 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:20.253 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:18:20.269 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:20.283 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:20.312 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:20.510 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:18:20.526 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:20.539 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:18:20.555 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:18:20.568 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:20.589 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:20.834 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:18:20.850 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:20.893 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:20.947 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:18:20.974 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T17:18:21.013 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:18:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:18:21.315 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T17:18:21.342 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:18:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:18:21.358 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T17:18:21.401 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:18:21.701 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:18:21.716 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T17:18:21.759 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:18:21.812 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:18:21.839 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:18:21.878 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:18:22.187 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:18:22.198 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:18:22.214 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:18:22.226 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T17:18:22.253 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:18:22.265 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T17:18:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:18:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T17:18:22.610 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T17:18:22.637 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T17:18:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T17:18:22.676 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:18:23.010 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T17:18:23.037 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T17:18:23.085 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:18:23.113 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:18:23.141 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T17:18:23.179 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:18:23.474 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:18:23.501 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T17:18:23.540 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:18:23.556 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:18:23.583 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T17:18:23.622 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:18:23.827 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:18:23.854 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T17:18:23.893 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:18:23.909 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:18:23.936 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T17:18:23.975 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:18:24.236 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:18:24.252 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T17:18:24.294 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:18:24.639 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:18:24.666 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-radosgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:24.704 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:25.090 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:18:25.118 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../113-radosgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:25.156 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:25.508 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:18:25.524 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:25.574 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:25.844 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T17:18:26.087 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:18:26.156 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:18:26.184 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:18:26.227 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:26.346 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:18:26.510 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T17:18:26.745 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T17:18:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:18:26.900 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:18:27.089 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T17:18:27.161 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T17:18:27.486 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T17:18:27.514 INFO:teuthology.orchestra.run.smithi190.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T17:18:27.581 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:27.932 INFO:teuthology.orchestra.run.smithi167.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T17:18:28.018 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:28.083 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2024-09-13T17:18:28.231 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:18:28.516 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:18:28.611 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user cephadm....done 2024-09-13T17:18:28.775 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:18:28.818 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:18:28.901 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:18:29.160 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:18:29.311 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:18:29.428 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:18:29.537 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T17:18:29.579 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:18:29.814 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:18:29.965 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:18:30.149 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T17:18:30.208 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:18:30.334 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T17:18:30.417 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T17:18:30.636 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:18:30.676 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T17:18:30.952 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:18:30.987 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T17:18:31.195 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:18:31.239 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T17:18:31.446 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:18:31.689 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T17:18:31.957 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:18:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:18:32.083 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T17:18:32.342 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:18:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:18:32.601 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:18:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:18:32.728 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T17:18:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:33.079 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:18:33.205 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T17:18:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T17:18:33.464 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:18:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:18:33.707 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:18:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:18:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T17:18:34.008 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:18:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T17:18:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:18:34.693 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:18:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:18:34.953 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:18:35.054 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:18:35.154 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:18:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:18:35.439 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T17:18:35.823 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T17:18:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:18:36.074 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:18:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:18:36.244 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:18:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:18:36.459 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:18:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T17:18:36.902 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T17:18:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T17:18:37.203 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:18:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:18:37.529 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:18:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:18:37.781 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:18:37.907 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T17:18:38.200 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:18:38.245 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:18:38.517 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:18:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:18:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:18:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:18:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:18:39.689 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:18:39.824 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T17:18:40.083 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:18:40.218 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:18:40.360 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:18:40.653 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:18:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:18:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T17:18:40.912 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T17:18:41.139 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:18:41.167 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:18:41.256 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:18:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:18:41.679 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:18:41.684 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:18:41.943 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T17:18:41.964 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T17:18:42.203 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T17:18:42.215 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:18:42.350 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:18:42.445 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:18:42.475 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:18:42.688 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T17:18:42.810 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:18:42.947 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:18:43.053 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T17:18:43.073 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T17:18:43.304 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T17:18:43.349 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:18:43.467 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:18:43.547 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:18:43.751 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:18:43.798 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T17:18:44.066 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:18:44.069 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:18:44.192 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T17:18:44.304 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:44.468 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:18:44.594 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:18:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T17:18:44.872 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:18:44.931 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:18:45.057 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:18:45.163 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:18:45.414 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:18:45.442 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:18:45.693 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T17:18:45.843 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T17:18:45.961 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:18:46.087 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:18:46.126 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:18:46.252 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:18:46.404 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:18:46.637 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:18:46.689 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:18:46.880 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T17:18:47.132 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:18:47.165 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T17:18:47.257 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:18:47.291 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T17:18:47.567 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T17:18:47.583 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:18:47.852 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:18:47.876 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:18:48.111 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:18:48.135 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T17:18:48.245 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T17:18:48.487 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:18:48.496 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T17:18:48.755 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:18:48.805 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:18:49.015 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:18:49.149 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:18:49.266 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:49.384 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:49.400 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:18:49.587 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:49.713 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:49.726 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:18:49.839 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:49.965 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T17:18:50.053 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:18:50.154 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.242 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.272 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.368 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.486 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.492 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.618 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.681 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:18:50.681 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:18:50.744 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:50.845 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T17:18:51.106 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:51.129 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:51.230 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:51.231 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:51.356 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:51.360 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:51.507 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:18:51.574 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:18:51.574 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:18:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:52.154 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:52.255 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:52.381 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:18:52.744 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:52.929 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.055 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.181 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.307 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.433 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.619 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.745 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.871 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:53.951 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:54.124 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:54.250 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:54.327 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2024-09-13T17:18:54.486 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2024-09-13T17:18:54.500 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:18:54.641 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:18:54.793 INFO:teuthology.orchestra.run.smithi167.stdout:Adding group ceph....done 2024-09-13T17:18:54.941 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:18:55.153 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user ceph....done 2024-09-13T17:18:55.305 INFO:teuthology.orchestra.run.smithi167.stdout:Setting system user ceph properties....done 2024-09-13T17:18:55.324 INFO:teuthology.orchestra.run.smithi167.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:18:55.434 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:55.457 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:18:55.634 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:18:55.635 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:18:55.785 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:18:56.093 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:56.219 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:56.276 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:56.473 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:18:56.473 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:18:56.683 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:18:56.684 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:18:56.928 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:57.029 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:57.129 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:57.476 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:18:57.484 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:18:57.484 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:18:57.931 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:57.947 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:58.165 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:18:58.165 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:18:58.292 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:18:58.649 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:58.774 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:58.877 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:18:58.877 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:18:59.007 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:18:59.007 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:18:59.334 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:59.477 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:18:59.620 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:18:59.620 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:18:59.681 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:18:59.681 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:19:00.119 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:00.178 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:00.254 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:00.388 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:00.453 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:19:00.453 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:19:00.597 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:19:00.598 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:19:00.997 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:01.123 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:01.168 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:01.274 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:01.400 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:01.488 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:19:01.488 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:19:01.617 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:01.851 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:01.984 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:02.135 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:02.204 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:19:02.514 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:02.729 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:19:03.021 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:19:03.082 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:19:03.474 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:19:03.477 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:19:03.533 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-13T17:19:03.743 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-13T17:19:03.744 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:19:03.934 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:19:03.935 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:19:03.935 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:19:03.936 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-13T17:19:03.936 INFO:teuthology.orchestra.run.smithi190.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T17:19:03.936 INFO:teuthology.orchestra.run.smithi190.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T17:19:03.936 INFO:teuthology.orchestra.run.smithi190.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T17:19:03.936 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T17:19:03.936 INFO:teuthology.orchestra.run.smithi190.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:19:03.937 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-13T17:19:03.937 INFO:teuthology.orchestra.run.smithi190.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T17:19:03.937 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T17:19:03.937 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T17:19:03.980 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-13T17:19:03.980 INFO:teuthology.orchestra.run.smithi190.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T17:19:03.980 INFO:teuthology.orchestra.run.smithi190.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T17:19:03.981 INFO:teuthology.orchestra.run.smithi190.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T17:19:03.981 INFO:teuthology.orchestra.run.smithi190.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T17:19:03.981 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T17:19:03.981 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T17:19:03.982 INFO:teuthology.orchestra.run.smithi190.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:19:03.982 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2024-09-13T17:19:03.983 INFO:teuthology.orchestra.run.smithi190.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T17:19:04.034 INFO:teuthology.orchestra.run.smithi190.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-13T17:19:04.034 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 55.8 MB of archives. 2024-09-13T17:19:04.034 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T17:19:04.034 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T17:19:04.158 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:19:04.166 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T17:19:04.173 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T17:19:04.213 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T17:19:04.214 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T17:19:04.214 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T17:19:04.225 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T17:19:04.226 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T17:19:04.228 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T17:19:04.229 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T17:19:04.229 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T17:19:04.231 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T17:19:04.232 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T17:19:04.248 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T17:19:04.249 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T17:19:04.249 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T17:19:04.548 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T17:19:04.550 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T17:19:04.550 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T17:19:04.553 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T17:19:04.553 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T17:19:04.557 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T17:19:04.559 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T17:19:04.566 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T17:19:04.566 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T17:19:04.587 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T17:19:04.587 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T17:19:04.596 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T17:19:04.616 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T17:19:04.619 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T17:19:04.620 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T17:19:04.620 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T17:19:04.621 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T17:19:04.631 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T17:19:04.632 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T17:19:04.641 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:19:04.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:19:04.740 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-13T17:19:04.832 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T17:19:04.832 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T17:19:04.832 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T17:19:04.832 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T17:19:04.832 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T17:19:04.832 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T17:19:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T17:19:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T17:19:04.950 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-09-13T17:19:04.951 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-09-13T17:19:05.160 INFO:teuthology.orchestra.run.smithi167.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T17:19:05.160 INFO:teuthology.orchestra.run.smithi167.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T17:19:05.160 INFO:teuthology.orchestra.run.smithi167.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T17:19:05.160 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:19:05.160 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:19:05.160 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:19:05.161 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:19:05.161 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:19:05.161 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:19:05.161 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:19:05.162 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2024-09-13T17:19:05.162 INFO:teuthology.orchestra.run.smithi167.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T17:19:05.162 INFO:teuthology.orchestra.run.smithi167.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T17:19:05.163 INFO:teuthology.orchestra.run.smithi167.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T17:19:05.163 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T17:19:05.163 INFO:teuthology.orchestra.run.smithi167.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:19:05.164 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2024-09-13T17:19:05.164 INFO:teuthology.orchestra.run.smithi167.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T17:19:05.164 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T17:19:05.164 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T17:19:05.208 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2024-09-13T17:19:05.209 INFO:teuthology.orchestra.run.smithi167.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T17:19:05.209 INFO:teuthology.orchestra.run.smithi167.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T17:19:05.209 INFO:teuthology.orchestra.run.smithi167.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T17:19:05.210 INFO:teuthology.orchestra.run.smithi167.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T17:19:05.210 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T17:19:05.210 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T17:19:05.210 INFO:teuthology.orchestra.run.smithi167.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:19:05.211 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages will be upgraded: 2024-09-13T17:19:05.212 INFO:teuthology.orchestra.run.smithi167.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T17:19:05.245 INFO:teuthology.orchestra.run.smithi190.stdout:Preconfiguring packages ... 2024-09-13T17:19:05.263 INFO:teuthology.orchestra.run.smithi167.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-13T17:19:05.264 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 55.8 MB of archives. 2024-09-13T17:19:05.264 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T17:19:05.264 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T17:19:05.386 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 55.8 MB in 1s (65.3 MB/s) 2024-09-13T17:19:05.396 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T17:19:05.403 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T17:19:05.441 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T17:19:05.442 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T17:19:05.443 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T17:19:05.453 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T17:19:05.454 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T17:19:05.456 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T17:19:05.458 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T17:19:05.458 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T17:19:05.460 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T17:19:05.461 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T17:19:05.476 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T17:19:05.477 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T17:19:05.478 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T17:19:05.717 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T17:19:05.722 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:19:05.810 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T17:19:05.812 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T17:19:05.812 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T17:19:05.815 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T17:19:05.815 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T17:19:05.819 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T17:19:05.821 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T17:19:05.828 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T17:19:05.828 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T17:19:05.848 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T17:19:05.848 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T17:19:05.858 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T17:19:05.876 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:19:05.877 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T17:19:05.880 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T17:19:05.880 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T17:19:05.881 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T17:19:05.881 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T17:19:05.892 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T17:19:05.893 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T17:19:06.084 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T17:19:06.084 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T17:19:06.084 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T17:19:06.084 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T17:19:06.085 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T17:19:06.085 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T17:19:06.096 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T17:19:06.096 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T17:19:06.488 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T17:19:06.509 INFO:teuthology.orchestra.run.smithi167.stdout:Preconfiguring packages ... 2024-09-13T17:19:06.643 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 55.8 MB in 1s (63.6 MB/s) 2024-09-13T17:19:06.962 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T17:19:06.968 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:19:07.116 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:19:07.503 INFO:teuthology.orchestra.run.smithi190.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T17:19:07.816 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package flex. 2024-09-13T17:19:07.870 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T17:19:07.920 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T17:19:07.925 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T17:19:07.963 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T17:19:08.488 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:19:08.661 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T17:19:08.823 INFO:teuthology.orchestra.run.smithi167.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T17:19:09.062 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:19:09.081 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package flex. 2024-09-13T17:19:09.180 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T17:19:09.185 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T17:19:09.229 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T17:19:09.732 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T17:19:09.738 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:19:09.745 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:19:09.868 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:19:09.918 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T17:19:10.235 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:19:10.328 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:19:10.349 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:19:10.675 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:19:10.839 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T17:19:10.844 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:19:10.976 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:19:11.041 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package bison. 2024-09-13T17:19:11.145 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T17:19:11.150 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T17:19:11.210 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:19:11.411 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:19:11.516 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:19:11.611 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:19:11.638 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T17:19:11.677 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:19:11.851 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:19:12.014 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package dump. 2024-09-13T17:19:12.041 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T17:19:12.080 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T17:19:12.226 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package bison. 2024-09-13T17:19:12.330 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T17:19:12.336 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T17:19:12.358 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package indent. 2024-09-13T17:19:12.375 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:12.377 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:19:12.409 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:19:12.636 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:19:12.652 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T17:19:12.695 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:19:12.905 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:19:12.933 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T17:19:12.972 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:19:13.108 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:19:13.135 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T17:19:13.174 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:19:13.269 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package dump. 2024-09-13T17:19:13.926 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:19:13.926 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T17:19:13.926 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:19:13.926 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package indent. 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:19:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T17:19:13.965 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:19:14.149 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T17:19:14.165 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T17:19:14.208 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:14.236 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:19:14.252 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T17:19:14.286 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:19:14.444 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T17:19:14.471 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T17:19:14.510 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T17:19:14.522 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:19:14.540 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T17:19:14.581 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:19:14.789 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T17:19:14.816 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T17:19:14.855 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:19:14.942 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T17:19:14.970 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T17:19:15.009 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:15.262 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T17:19:15.278 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T17:19:15.312 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:15.548 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T17:19:15.564 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T17:19:15.606 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T17:19:15.910 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T17:19:15.937 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T17:19:15.976 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:19:16.525 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:19:16.552 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:19:16.591 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:16.835 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:19:16.851 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:19:16.908 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:17.205 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:19:17.232 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:19:17.271 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:17.563 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:19:17.591 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:19:17.616 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:19:17.643 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T17:19:17.655 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:17.682 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:19:17.916 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:19:17.932 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:19:17.974 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:18.277 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:19:18.305 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:19:18.335 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:19:18.403 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:19:18.520 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:19:18.689 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:19:18.716 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T17:19:18.755 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:19:18.860 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:19:18.884 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:18.924 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:19.083 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:19:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:19:19.149 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:19:19.251 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:19:19.279 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:19.326 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:19.461 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:19:19.489 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:19.519 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:19.612 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:19:19.629 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:19.848 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:19:19.864 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:19:19.875 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:19.880 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:19:19.914 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:19:20.209 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:20.277 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:20.426 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:19:20.454 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T17:19:20.518 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:19:20.519 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:19:20.586 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:19:20.796 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:19:20.824 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:19:20.854 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:19:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T17:19:21.315 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:19:21.486 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:19:21.513 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:19:21.569 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:19:21.602 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:19:21.629 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:19:21.660 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:22.159 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ppp. 2024-09-13T17:19:22.187 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T17:19:22.351 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:19:22.378 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:19:22.425 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:19:22.467 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:19:22.781 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:19:22.809 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T17:19:22.847 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T17:19:23.059 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ppp. 2024-09-13T17:19:23.087 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T17:19:23.108 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:19:23.124 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T17:19:23.158 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T17:19:23.356 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:19:23.394 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:19:23.410 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T17:19:23.444 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T17:19:23.631 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:19:23.659 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T17:19:23.698 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T17:19:23.875 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T17:19:23.903 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:23.941 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:23.950 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:19:23.966 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T17:19:24.009 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T17:19:24.321 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:19:24.348 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T17:19:24.387 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T17:19:24.497 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:19:24.524 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T17:19:24.574 INFO:teuthology.orchestra.run.smithi190.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:19:24.602 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-common (238) ... 2024-09-13T17:19:24.666 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T17:19:24.694 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:24.733 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:25.028 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T17:19:25.056 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:25.090 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:25.321 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:19:25.349 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T17:19:25.407 INFO:teuthology.orchestra.run.smithi167.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:19:25.436 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-common (238) ... 2024-09-13T17:19:25.937 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T17:19:25.965 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:19:26.007 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:26.389 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:19:26.406 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T17:19:26.447 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql (14+238) ... 2024-09-13T17:19:26.658 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:19:26.674 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T17:19:26.716 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T17:19:26.960 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:19:26.988 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T17:19:27.026 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T17:19:27.174 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:19:27.191 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T17:19:27.232 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql (14+238) ... 2024-09-13T17:19:27.329 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T17:19:27.356 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T17:19:27.395 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:19:27.518 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:19:27.534 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T17:19:27.568 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T17:19:27.690 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl. 2024-09-13T17:19:27.718 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T17:19:27.753 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T17:19:27.803 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:19:27.831 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T17:19:27.989 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T17:19:28.101 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:19:28.129 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T17:19:28.167 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:19:28.308 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T17:19:28.336 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T17:19:28.375 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:19:28.530 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:19:28.558 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T17:19:28.596 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T17:19:28.611 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package tcl. 2024-09-13T17:19:28.627 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T17:19:28.666 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T17:19:28.925 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:19:28.953 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T17:19:28.991 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:19:29.031 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:19:29.059 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T17:19:29.097 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:19:29.269 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T17:19:29.460 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:19:29.464 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T17:19:29.477 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T17:19:29.518 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T17:19:29.581 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:19:29.707 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:29.833 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:19:29.838 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:19:29.867 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T17:19:29.913 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:19:29.959 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:19:30.068 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:30.201 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T17:19:30.419 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T17:19:30.540 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:19:30.548 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:19:30.624 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:19:30.666 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:30.775 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:19:30.901 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:19:30.992 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:19:30.993 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:19:31.027 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:31.477 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:19:31.501 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:19:31.574 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:19:31.586 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:19:31.712 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:19:31.838 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T17:19:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:19:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:19:31.964 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:19:32.090 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:19:32.342 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:19:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:19:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:19:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:19:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T17:19:32.963 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:19:33.090 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T17:19:33.183 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:19:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:19:33.249 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:33.442 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:19:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:33.568 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T17:19:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:19:33.685 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T17:19:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:19:33.962 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:19:34.293 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T17:19:34.355 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:19:34.481 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:19:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T17:19:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:19:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:19:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:34.792 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:19:34.943 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T17:19:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T17:19:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T17:19:35.102 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T17:19:35.203 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:19:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:19:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T17:19:35.381 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:19:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:19:35.666 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:35.666 INFO:teuthology.orchestra.run.smithi190.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:19:35.666 INFO:teuthology.orchestra.run.smithi190.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:19:35.666 INFO:teuthology.orchestra.run.smithi190.stdout:- enp3s0f1 2024-09-13T17:19:35.666 INFO:teuthology.orchestra.run.smithi190.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:19:35.666 INFO:teuthology.orchestra.run.smithi190.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:19:35.667 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:35.684 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:19:35.792 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:19:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T17:19:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T17:19:36.121 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:19:36.437 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:19:36.723 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:19:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:19:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:- enp3s0f1 2024-09-13T17:19:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:19:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:19:36.724 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:19:36.939 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:37.082 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:19:37.208 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T17:19:37.334 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-common (238) ... 2024-09-13T17:19:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:19:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:19:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:19:38.220 INFO:teuthology.orchestra.run.smithi190.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:19:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T17:19:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-common (238) ... 2024-09-13T17:19:38.470 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:38.470 INFO:teuthology.orchestra.run.smithi190.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:19:38.661 INFO:teuthology.orchestra.run.smithi190.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:19:38.661 INFO:teuthology.orchestra.run.smithi190.stdout:Removing obsolete dictionary files: 2024-09-13T17:19:39.195 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:19:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:19:39.585 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:39.788 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:19:39.910 INFO:teuthology.orchestra.run.smithi190.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T17:19:39.930 INFO:teuthology.orchestra.run.smithi190.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T17:19:39.972 INFO:teuthology.orchestra.run.smithi190.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:19:39.972 INFO:teuthology.orchestra.run.smithi190.stdout:This user must also own the server process. 2024-09-13T17:19:39.972 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:39.972 INFO:teuthology.orchestra.run.smithi190.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:19:39.972 INFO:teuthology.orchestra.run.smithi190.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:19:39.973 INFO:teuthology.orchestra.run.smithi190.stdout:The default text search configuration will be set to "english". 2024-09-13T17:19:39.973 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:39.973 INFO:teuthology.orchestra.run.smithi190.stdout:Data page checksums are disabled. 2024-09-13T17:19:39.973 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:39.973 INFO:teuthology.orchestra.run.smithi190.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T17:19:39.973 INFO:teuthology.orchestra.run.smithi190.stdout:creating subdirectories ... ok 2024-09-13T17:19:39.973 INFO:teuthology.orchestra.run.smithi190.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:19:39.988 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default max_connections ... 100 2024-09-13T17:19:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:19:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:Removing obsolete dictionary files: 2024-09-13T17:19:40.007 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:19:40.022 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:19:40.024 INFO:teuthology.orchestra.run.smithi190.stdout:creating configuration files ... ok 2024-09-13T17:19:40.137 INFO:teuthology.orchestra.run.smithi190.stdout:running bootstrap script ... ok 2024-09-13T17:19:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:19:40.754 INFO:teuthology.orchestra.run.smithi190.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:19:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:19:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T17:19:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:This user must also own the server process. 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:The default text search configuration will be set to "english". 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:Data page checksums are disabled. 2024-09-13T17:19:41.369 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T17:19:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:creating subdirectories ... ok 2024-09-13T17:19:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:19:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default max_connections ... 100 2024-09-13T17:19:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:19:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:19:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:creating configuration files ... ok 2024-09-13T17:19:41.455 INFO:teuthology.orchestra.run.smithi190.stdout:syncing data to disk ... ok 2024-09-13T17:19:41.527 INFO:teuthology.orchestra.run.smithi167.stdout:running bootstrap script ... ok 2024-09-13T17:19:41.823 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:19:42.190 INFO:teuthology.orchestra.run.smithi167.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:19:42.865 INFO:teuthology.orchestra.run.smithi167.stdout:syncing data to disk ... ok 2024-09-13T17:19:43.299 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:19:44.549 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:44.675 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T17:19:44.793 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql (14+238) ... 2024-09-13T17:19:44.902 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:45.011 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:45.273 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:19:45.273 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:19:45.798 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T17:19:45.990 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:19:46.060 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:46.169 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T17:19:46.296 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql (14+238) ... 2024-09-13T17:19:46.317 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:19:46.421 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:19:46.469 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:19:46.539 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:19:46.777 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:19:46.777 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:19:47.309 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T17:19:47.527 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:19:47.805 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T17:19:47.854 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:19:47.896 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T17:19:48.006 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:19:48.528 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:19:48.533 DEBUG:teuthology.parallel:result is None 2024-09-13T17:19:49.326 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T17:19:49.417 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T17:19:50.030 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:19:50.034 DEBUG:teuthology.parallel:result is None 2024-09-13T17:19:50.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:19:50.193 DEBUG:teuthology.orchestra.run.smithi167:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:19:50.211 INFO:teuthology.orchestra.run.smithi167.stdout:18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:19:50.212 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:19:50.212 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1jammy is installed. 2024-09-13T17:19:50.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:19:50.367 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:19:50.387 INFO:teuthology.orchestra.run.smithi190.stdout:18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:19:50.387 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:19:50.387 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1jammy is installed. 2024-09-13T17:19:50.389 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T17:19:50.389 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:50.389 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:19:50.403 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:50.403 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:19:50.443 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T17:19:50.443 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:50.443 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:19:50.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:19:50.514 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:50.514 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:19:50.527 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:19:50.585 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T17:19:50.586 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:50.586 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:19:50.598 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:19:50.654 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:50.654 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:19:50.667 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:19:50.721 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T17:19:50.721 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:50.722 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:19:50.733 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:19:50.785 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:50.785 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:19:50.799 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:19:50.853 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T17:19:50.927 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T17:19:50.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-09-13T17:19:50.930 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2024-09-13T17:19:50.943 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T17:19:50.943 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:19:50.984 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:19:50.997 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T17:19:50.997 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:19:51.036 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:19:51.060 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T17:19:51.060 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T17:19:51.060 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T17:19:51.060 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:51.060 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:19:51.095 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:19:51.172 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:51.172 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:19:51.178 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:19:51.259 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T17:19:51.259 INFO:tasks.ceph:config {'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T17:19:51.259 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc}', 'email': None, 'first_in_suite': False, 'job_id': '7903879', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+gkCYj5RBp6JZk63sE519jbx497sfBC1Za82waoINOeblSEV50Yr5glLJNmMSnUfa47hAmOul0vAqCgFcujAo=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSSRHXIakytNkBqzQmK3Ciw6O+Exof5PKBfHBxnIVgmZJz2/frrHOOE/8MoKaIDLoGILT+vxwVsYSyCzK8copE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/acl.sh', 'fs/misc/chmod.sh', 'fs/misc/dac_override.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T17:19:51.260 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:19:51.262 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:19:51.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:19:51.308 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:19:51.361 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:51.361 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:19:51.367 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:19:51.367 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-13T17:19:51.415 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:19:51.415 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:51.415 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-13T17:19:51.415 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:51.416 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-13 17:13:40.322784641 +0000 2024-09-13T17:19:51.416 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-13 17:13:40.074786857 +0000 2024-09-13T17:19:51.416 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-13 17:13:40.074786857 +0000 2024-09-13T17:19:51.416 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-13T17:19:51.416 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:19:51.469 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-13T17:19:51.470 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-13T17:19:51.470 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000383209 s, 1.3 MB/s 2024-09-13T17:19:51.471 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:19:51.520 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-13T17:19:51.567 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:19:51.567 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:51.567 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-13T17:19:51.567 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:51.567 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-13 17:13:40.826780140 +0000 2024-09-13T17:19:51.567 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-13 17:13:40.558782533 +0000 2024-09-13T17:19:51.567 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-13 17:13:40.558782533 +0000 2024-09-13T17:19:51.568 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-13T17:19:51.568 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:19:51.621 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-13T17:19:51.622 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-13T17:19:51.622 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000450729 s, 1.1 MB/s 2024-09-13T17:19:51.623 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:19:51.672 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-13T17:19:51.718 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:19:51.719 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:51.719 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-13T17:19:51.719 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:51.719 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-13 17:13:41.314775781 +0000 2024-09-13T17:19:51.719 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-13 17:13:41.062778032 +0000 2024-09-13T17:19:51.719 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-13 17:13:41.062778032 +0000 2024-09-13T17:19:51.719 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-13T17:19:51.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:19:51.773 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-13T17:19:51.773 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-13T17:19:51.773 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000440343 s, 1.2 MB/s 2024-09-13T17:19:51.774 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:19:51.824 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-13 17:13:41.590773316 +0000 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-13 17:13:41.586773351 +0000 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-13 17:13:41.586773351 +0000 2024-09-13T17:19:51.871 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-13T17:19:51.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:19:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-13T17:19:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-13T17:19:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000390377 s, 1.3 MB/s 2024-09-13T17:19:51.926 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:19:51.976 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:19:51.976 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:51.976 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:19:51.982 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:19:51.982 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-09-13T17:19:52.030 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:19:52.030 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:52.030 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-13T17:19:52.030 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:52.031 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-13 17:13:40.334519393 +0000 2024-09-13T17:19:52.031 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-13 17:13:40.086521608 +0000 2024-09-13T17:19:52.031 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-13 17:13:40.086521608 +0000 2024-09-13T17:19:52.031 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-13T17:19:52.031 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:19:52.084 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-13T17:19:52.085 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-13T17:19:52.085 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000452606 s, 1.1 MB/s 2024-09-13T17:19:52.086 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:19:52.135 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-09-13T17:19:52.181 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:19:52.181 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:52.182 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-13T17:19:52.182 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:52.182 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-13 17:13:40.862514676 +0000 2024-09-13T17:19:52.182 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-13 17:13:40.602516998 +0000 2024-09-13T17:19:52.182 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-13 17:13:40.602516998 +0000 2024-09-13T17:19:52.182 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-13T17:19:52.183 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:19:52.237 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-13T17:19:52.237 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-13T17:19:52.237 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000462171 s, 1.1 MB/s 2024-09-13T17:19:52.238 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:19:52.287 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-09-13T17:19:52.334 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:19:52.334 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:52.334 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-13T17:19:52.334 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:52.334 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-13 17:13:41.358510246 +0000 2024-09-13T17:19:52.334 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-13 17:13:41.086512675 +0000 2024-09-13T17:19:52.335 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-13 17:13:41.086512675 +0000 2024-09-13T17:19:52.335 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-13T17:19:52.335 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:19:52.388 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-13T17:19:52.389 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-13T17:19:52.389 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000420807 s, 1.2 MB/s 2024-09-13T17:19:52.390 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:19:52.439 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-09-13T17:19:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:19:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:19:52.486 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-13T17:19:52.486 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:19:52.486 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-13 17:13:41.842505923 +0000 2024-09-13T17:19:52.487 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-13 17:13:41.630507817 +0000 2024-09-13T17:19:52.487 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-13 17:13:41.630507817 +0000 2024-09-13T17:19:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-13T17:19:52.487 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:19:52.540 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-13T17:19:52.540 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-13T17:19:52.540 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.00030027 s, 1.7 MB/s 2024-09-13T17:19:52.541 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:19:52.591 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:19:52.591 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:19:52.591 INFO:tasks.ceph:Generating config... 2024-09-13T17:19:52.592 INFO:tasks.ceph:[client] client acl type = posix_acl 2024-09-13T17:19:52.593 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T17:19:52.593 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T17:19:52.593 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T17:19:52.593 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T17:19:52.593 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T17:19:52.593 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T17:19:52.593 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T17:19:52.593 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T17:19:52.593 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T17:19:52.593 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T17:19:52.593 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T17:19:52.594 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T17:19:52.595 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T17:19:52.596 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T17:19:52.596 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T17:19:52.641 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T17:19:52.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:19:52.779 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.167'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2024-09-13T17:19:52.779 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.167,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T17:19:52.780 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:52.780 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:19:52.827 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.167 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:19:52.912 INFO:teuthology.orchestra.run.smithi167.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:19:52.912 INFO:teuthology.orchestra.run.smithi167.stdout:monmaptool: generated fsid 77832f00-b4f4-4330-b095-2fc2c7bace94 2024-09-13T17:19:52.912 INFO:teuthology.orchestra.run.smithi167.stdout:setting min_mon_release = pacific 2024-09-13T17:19:52.912 INFO:teuthology.orchestra.run.smithi167.stdout:epoch 0 2024-09-13T17:19:52.912 INFO:teuthology.orchestra.run.smithi167.stdout:fsid 77832f00-b4f4-4330-b095-2fc2c7bace94 2024-09-13T17:19:52.912 INFO:teuthology.orchestra.run.smithi167.stdout:last_changed 2024-09-13T17:19:52.914116+0000 2024-09-13T17:19:52.912 INFO:teuthology.orchestra.run.smithi167.stdout:created 2024-09-13T17:19:52.914116+0000 2024-09-13T17:19:52.913 INFO:teuthology.orchestra.run.smithi167.stdout:min_mon_release 16 (pacific) 2024-09-13T17:19:52.913 INFO:teuthology.orchestra.run.smithi167.stdout:election_strategy: 1 2024-09-13T17:19:52.913 INFO:teuthology.orchestra.run.smithi167.stdout:0: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.a 2024-09-13T17:19:52.913 INFO:teuthology.orchestra.run.smithi167.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-13T17:19:52.913 INFO:teuthology.orchestra.run.smithi167.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2024-09-13T17:19:52.913 INFO:teuthology.orchestra.run.smithi167.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T17:19:52.914 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:19:52.962 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 77832f00-b4f4-4330-b095-2fc2c7bace94... 2024-09-13T17:19:52.963 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:19:53.008 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:19:53.034 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-09-13T17:19:53.034 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-09-13T17:19:53.034 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:19:53.034 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-09-13T17:19:53.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:19:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:19:53.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.167,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-09-13T17:19:53.037 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 77832f00-b4f4-4330-b095-2fc2c7bace94 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-09-13T17:19:53.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-09-13T17:19:53.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-13T17:19:53.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:19:53.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on pool no app = False 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:19:53.043 INFO:teuthology.orchestra.run.smithi167.stdout: client acl type = posix_acl 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-09-13T17:19:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-09-13T17:19:53.046 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-09-13T17:19:53.046 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-09-13T17:19:53.048 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-09-13T17:19:53.049 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.167,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 77832f00-b4f4-4330-b095-2fc2c7bace94 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.050 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:19:53.051 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-09-13T17:19:53.052 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-09-13T17:19:53.053 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:53.054 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:19:53.055 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on pool no app = False 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: client acl type = posix_acl 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-09-13T17:19:53.056 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-09-13T17:19:53.057 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2024-09-13T17:19:53.058 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-09-13T17:19:53.058 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2024-09-13T17:19:53.058 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-09-13T17:19:53.058 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-09-13T17:19:53.058 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-09-13T17:19:53.058 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T17:19:53.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T17:19:53.138 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T17:19:53.138 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:53.138 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T17:19:53.143 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:53.143 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T17:19:53.190 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:19:53.191 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:53.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:19:53.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:19:53.255 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:19:53.255 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:19:53.302 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:19:53.303 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:53.303 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:19:53.303 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:19:53.325 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:19:53.325 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:19:53.378 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T17:19:53.378 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T17:19:53.378 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:19:53.423 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:19:53.426 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:19:53.470 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:19:53.479 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T17:19:53.479 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:19:53.521 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:19:53.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T17:19:53.578 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:19:53.623 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:19:53.626 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T17:19:53.681 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T17:19:53.681 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T17:19:53.716 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T17:19:53.725 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T17:19:53.725 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:19:53.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T17:19:53.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:19:53.779 INFO:tasks.ceph:role: osd.0 2024-09-13T17:19:53.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:19:53.779 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:19:53.842 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:19:54.285 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-13T17:19:54.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-13T17:19:54.287 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T17:19:54.377 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T17:19:54.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:54.387 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:19:54.387 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T17:19:54.440 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:19:54.441 INFO:tasks.ceph:role: osd.1 2024-09-13T17:19:54.441 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:19:54.441 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:19:54.503 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:19:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:19:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:19:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:19:54.503 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:19:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:19:54.503 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:19:54.504 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:19:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:19:54.504 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:19:54.967 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-13T17:19:54.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-13T17:19:54.969 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T17:19:55.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T17:19:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:19:55.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:55.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T17:19:55.189 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:19:55.189 INFO:tasks.ceph:role: osd.2 2024-09-13T17:19:55.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:19:55.190 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:19:55.251 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:19:55.251 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:19:55.251 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:19:55.252 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:19:55.252 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:19:55.252 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:19:55.252 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:19:55.252 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:19:55.252 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:19:55.252 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:19:55.739 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-13T17:19:55.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-13T17:19:55.741 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T17:19:55.892 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T17:19:55.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:19:55.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T17:19:55.959 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:19:55.959 INFO:tasks.ceph:role: osd.3 2024-09-13T17:19:55.959 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:19:55.959 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:19:56.023 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:19:56.023 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:19:56.023 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:19:56.023 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:19:56.023 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:19:56.024 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:19:56.024 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:19:56.024 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:19:56.024 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:19:56.024 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:19:56.447 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-13T17:19:56.449 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-13T17:19:56.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T17:19:56.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T17:19:56.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:56.553 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:19:56.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:19:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:56.652+0000 7fc01a8497c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T17:19:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:56.652+0000 7fc01a8497c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T17:19:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:56.652+0000 7fc01a8497c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:19:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:56.652+0000 7fc01a8497c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:19:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:56.652+0000 7fc01a8497c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:19:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:56.656+0000 7fc01a8497c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T17:19:59.639 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:19:59.653 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:19:59.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:59.736+0000 7fa5287a57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T17:19:59.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:59.736+0000 7fa5287a57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T17:19:59.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:59.736+0000 7fa5287a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:19:59.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:59.736+0000 7fa5287a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:19:59.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:59.736+0000 7fa5287a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:19:59.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:19:59.740+0000 7fa5287a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T17:20:02.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:20:02.772 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:02.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:02.852+0000 7f91b0b0a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T17:20:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:02.852+0000 7f91b0b0a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T17:20:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:02.852+0000 7f91b0b0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:20:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:02.852+0000 7f91b0b0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:20:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:02.852+0000 7f91b0b0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:20:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:02.852+0000 7f91b0b0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T17:20:05.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:20:05.876 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:05.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:05.952+0000 7f396fa9e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T17:20:05.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:05.952+0000 7f396fa9e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T17:20:05.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:05.952+0000 7f396fa9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:20:05.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:05.952+0000 7f396fa9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:20:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:05.952+0000 7f396fa9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:20:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:05.956+0000 7f396fa9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T17:20:08.934 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:20:08.991 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T17:20:09.006 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:20:09.006 INFO:tasks.ceph:role: osd.4 2024-09-13T17:20:09.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:20:09.006 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:20:09.070 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:20:09.524 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-13T17:20:09.526 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-13T17:20:09.527 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T17:20:09.615 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T17:20:09.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:09.668 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:20:09.668 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T17:20:09.719 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:20:09.719 INFO:tasks.ceph:role: osd.5 2024-09-13T17:20:09.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:20:09.719 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:20:09.779 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:20:09.780 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:20:10.251 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-13T17:20:10.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-13T17:20:10.253 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T17:20:10.411 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T17:20:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:20:10.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:10.424 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T17:20:10.477 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:20:10.477 INFO:tasks.ceph:role: osd.6 2024-09-13T17:20:10.478 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:20:10.478 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:20:10.541 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:20:10.542 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:20:11.023 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-13T17:20:11.025 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-13T17:20:11.025 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T17:20:11.173 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T17:20:11.184 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:20:11.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:11.185 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T17:20:11.245 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:20:11.245 INFO:tasks.ceph:role: osd.7 2024-09-13T17:20:11.245 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:20:11.245 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:20:11.309 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:20:11.736 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-13T17:20:11.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-13T17:20:11.738 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T17:20:11.845 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T17:20:11.856 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:20:11.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:11.857 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:11.980 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:11.977+0000 7f9aa844b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T17:20:11.983 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:11.981+0000 7f9aa844b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T17:20:11.983 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:11.981+0000 7f9aa844b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:20:11.984 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:11.981+0000 7f9aa844b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:20:11.984 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:11.981+0000 7f9aa844b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:20:11.984 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:11.981+0000 7f9aa844b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T17:20:14.985 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:20:14.998 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:15.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:15.077+0000 7f445188d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T17:20:15.080 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:15.077+0000 7f445188d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T17:20:15.080 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:15.077+0000 7f445188d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:20:15.080 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:15.077+0000 7f445188d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:20:15.080 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:15.077+0000 7f445188d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:20:15.081 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:15.077+0000 7f445188d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T17:20:18.058 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:20:18.114 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:18.194 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:18.193+0000 7ffbf0ca87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T17:20:18.195 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:18.193+0000 7ffbf0ca87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T17:20:18.195 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:18.193+0000 7ffbf0ca87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:20:18.195 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:18.193+0000 7ffbf0ca87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:20:18.195 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:18.193+0000 7ffbf0ca87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:20:18.196 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:18.193+0000 7ffbf0ca87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T17:20:21.164 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T17:20:21.218 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:21.261 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:21.264 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:21.301 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:21.297+0000 7ff9f230c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T17:20:21.301 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:21.301+0000 7ff9f230c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T17:20:21.301 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:21.301+0000 7ff9f230c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:20:21.301 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:21.301+0000 7ff9f230c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:20:21.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:21.301+0000 7ff9f230c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:20:21.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:21.301+0000 7ff9f230c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T17:20:24.278 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T17:20:24.292 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T17:20:24.292 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:24.292 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T17:20:24.307 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:24.307 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T17:20:24.362 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:24.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T17:20:24.417 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:24.417 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T17:20:24.470 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:24.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T17:20:24.526 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:24.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T17:20:24.582 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:24.582 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T17:20:24.596 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:24.596 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T17:20:24.653 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:24.653 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T17:20:24.708 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:24.709 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T17:20:24.764 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:24.764 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T17:20:24.816 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:24.816 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T17:20:24.868 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:24.868 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T17:20:24.873 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T17:20:24.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:20:24.920 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:20:24.929 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2024-09-13T17:20:24.929 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA5dORmByhWGRAAHp3TKLzAu0CShb/3aTOI5g== 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA5dORmnQk4HxAAno5b3eYt0MQRhv1ZkdC7lg== 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA8dORmcIUyJxAA7iKeqO4c922iFd2dfaiQRw== 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA/dORmGCFRLBAAls8FKi1HC4NDtr4/TQx5dg== 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2024-09-13T17:20:24.930 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBCdORmUTIQMxAA0YY7l0CCAPNlYumdSXWSwA== 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBFdORmHwonORAAin1vC0sbAuxYuXUsaHNJDA== 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA5dORmZ901HBAAqlCbeibg0Jlxx2LQEjl8FA== 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA5dORmBlVXJRAAqjvBYgxCBUdnC1x8Vi49oA== 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBLdORm0s2gOhAAlfQzB/W4+VOciQwbxZ+avA== 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBPdORmQxnxBBAAPXjSyBV2N4RVgQfpiHQS1A== 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBSdORmOfDRCxAAnOf75FwXWyjzpY/s8VbbgA== 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2024-09-13T17:20:24.931 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBVdORmp+EjEhAArQHVJT1ruJpb6cwni9TKQQ== 2024-09-13T17:20:24.932 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2024-09-13T17:20:24.932 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA5dORmmyXKKhAAg+jD+yEKU7nBzXdFEsE+gA== 2024-09-13T17:20:24.932 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2024-09-13T17:20:24.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA5dORmByhWGRAAHp3TKLzAu0CShb/3aTOI5g== 2024-09-13T17:20:24.932 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-09-13T17:20:24.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA5dORmnQk4HxAAno5b3eYt0MQRhv1ZkdC7lg== 2024-09-13T17:20:24.932 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA8dORmcIUyJxAA7iKeqO4c922iFd2dfaiQRw== 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA/dORmGCFRLBAAls8FKi1HC4NDtr4/TQx5dg== 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBCdORmUTIQMxAA0YY7l0CCAPNlYumdSXWSwA== 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBFdORmHwonORAAin1vC0sbAuxYuXUsaHNJDA== 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA5dORmZ901HBAAqlCbeibg0Jlxx2LQEjl8FA== 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA5dORmBlVXJRAAqjvBYgxCBUdnC1x8Vi49oA== 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBLdORm0s2gOhAAlfQzB/W4+VOciQwbxZ+avA== 2024-09-13T17:20:24.933 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBPdORmQxnxBBAAPXjSyBV2N4RVgQfpiHQS1A== 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBSdORmOfDRCxAAnOf75FwXWyjzpY/s8VbbgA== 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBVdORmp+EjEhAArQHVJT1ruJpb6cwni9TKQQ== 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA5dORmmyXKKhAAg+jD+yEKU7nBzXdFEsE+gA== 2024-09-13T17:20:24.935 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:20:24.979 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:20:25.025 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:20:25.027 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:20:25.115 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.118 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.201 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.291 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:20:25.459 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:20:25.502 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:20:25.548 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:20:25.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.595 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.676 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.678 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.764 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.766 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.848 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.851 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:20:25.928 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:20:25.935 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:20:26.014 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T17:20:26.015 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T17:20:26.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:20:26.119 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T17:20:26.130 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T17:20:26.144 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:20:26.240 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T17:20:26.251 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T17:20:26.302 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:20:26.392 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T17:20:26.448 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:26.450 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:20:26.496 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T17:20:26.497 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T17:20:26.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T17:20:26.499 INFO:tasks.ceph.mon.a:Started 2024-09-13T17:20:26.499 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T17:20:26.499 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T17:20:26.542 INFO:tasks.ceph.mon.b:Started 2024-09-13T17:20:26.542 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T17:20:26.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T17:20:26.544 INFO:tasks.ceph.mon.c:Started 2024-09-13T17:20:26.544 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T17:20:26.544 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T17:20:26.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T17:20:26.547 INFO:tasks.ceph.mgr.y:Started 2024-09-13T17:20:26.547 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T17:20:26.547 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T17:20:26.549 INFO:tasks.ceph.mgr.x:Started 2024-09-13T17:20:26.549 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T17:20:26.549 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T17:20:26.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e0d9e7640 1 Processor -- start 2024-09-13T17:20:26.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e0d9e7640 1 -- start start 2024-09-13T17:20:26.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e0d9e7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e0d9e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e0d9e7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e080ad2d0 con 0x7f5e0806a1e0 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e0d9e7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e080b4340 con 0x7f5e080ad760 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e0d9e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080adba0 con 0x7f5e08145f30 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e067fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e06ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f5e0806a1e0 0x7f5e080aef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.167:59630/0 (socket says 172.21.15.167:59630) 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e077fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e06ffd640 1 -- 172.21.15.167:0/124345167 learned_addr learned my addr 172.21.15.167:0/124345167 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e077fe640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 msgr2=0x7f5e081463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e077fe640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 msgr2=0x7f5e081463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e077fe640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e077fe640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e067fc640 1 -- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 msgr2=0x7f5e081459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:20:26.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e067fc640 1 -- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 msgr2=0x7f5e081459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:20:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e067fc640 1 --2- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:20:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.660+0000 7f5e067fc640 1 --2- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:20:26.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e077fe640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e067fc640 1 --2- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e077fe640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 msgr2=0x7f5e081463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:20:26.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e077fe640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 msgr2=0x7f5e081463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:20:26.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e077fe640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:20:26.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e077fe640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:20:26.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e067fc640 1 -- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 msgr2=0x7f5e081459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:20:26.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e067fc640 1 -- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 msgr2=0x7f5e081459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:20:26.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e067fc640 1 --2- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:20:26.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.864+0000 7f5e067fc640 1 --2- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:20:26.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170670027 0 0) 0x7f5e080ad2d0 con 0x7f5e0806a1e0 2024-09-13T17:20:26.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df0003530 con 0x7f5e0806a1e0 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3452870755 0 0) 0x7f5df0003530 con 0x7f5e0806a1e0 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 msgr2=0x7f5e081463e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5e081463e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 msgr2=0x7f5e081459f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 --2- 172.21.15.167:0/124345167 >> v2:172.21.15.190:3300/0 conn(0x7f5e080ad760 0x7f5e081459f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080ae870 con 0x7f5e0806a1e0 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f5df8001680 con 0x7f5e0806a1e0 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 >> v1:172.21.15.190:6789/0 conn(0x7f5e0806a1e0 legacy=0x7f5e080aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5df0003980 0x7f5df0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df00047d0 0x7f5df0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5df0005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b4340 con 0x7f5df0003980 2024-09-13T17:20:26.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df000bb20 con 0x7f5df00047d0 2024-09-13T17:20:26.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df000bcb0 con 0x7f5e08145f30 2024-09-13T17:20:26.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e06ffd640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5df0003980 0x7f5df0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e067fc640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df00047d0 0x7f5df0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.888+0000 7f5e077fe640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5df0005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.892+0000 7f5e06ffd640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 msgr2=0x7f5df0005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.892+0000 7f5e06ffd640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08145f30 0x7f5df0005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.892+0000 7f5e06ffd640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df00047d0 msgr2=0x7f5df0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.892+0000 7f5e06ffd640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df00047d0 0x7f5df0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.892+0000 7f5e06ffd640 1 -- 172.21.15.167:0/124345167 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0003530 con 0x7f5df0003980 2024-09-13T17:20:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.892+0000 7f5e067fc640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df00047d0 0x7f5df0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:26.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.896+0000 7f5e06ffd640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5df0003980 0x7f5df0003da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c290 tx=0x7f5df801cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185b4357bdd7da13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80a5950 con 0x7f5df0003980 2024-09-13T17:20:26.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df80a5ab0 con 0x7f5df0003980 2024-09-13T17:20:26.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e05ffb640 1 -- 172.21.15.167:0/124345167 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80a5e60 con 0x7f5df0003980 2024-09-13T17:20:26.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/124345167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5df0003980 msgr2=0x7f5df0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e0d9e7640 1 --2- 172.21.15.167:0/124345167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5df0003980 0x7f5df0003da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c290 tx=0x7f5df801cd00 comp rx=0 tx=0).stop 2024-09-13T17:20:26.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e077fe640 1 -- 172.21.15.167:0/124345167 reap_dead start 2024-09-13T17:20:26.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/124345167 shutdown_connections 2024-09-13T17:20:26.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/124345167 >> 172.21.15.167:0/124345167 conn(0x7f5e080b4db0 msgr2=0x7f5e080b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/124345167 shutdown_connections 2024-09-13T17:20:26.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.900+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/124345167 wait complete. 2024-09-13T17:20:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 Processor -- start 2024-09-13T17:20:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 -- start start 2024-09-13T17:20:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0003980 0x7f5e08070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e08146d90 0x7f5e080aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08147210 0x7f5e080af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08148080 con 0x7f5e08146d90 2024-09-13T17:20:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b0f90 con 0x7f5df0003980 2024-09-13T17:20:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e0d9e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b1bd0 con 0x7f5e08147210 2024-09-13T17:20:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0003980 0x7f5e08070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0003980 0x7f5e08070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:33466/0 (socket says 172.21.15.167:33466) 2024-09-13T17:20:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 -- 172.21.15.167:0/3094090753 learned_addr learned my addr 172.21.15.167:0/3094090753 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e067fc640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e08146d90 0x7f5e080aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e077fe640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08147210 0x7f5e080af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 -- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08147210 msgr2=0x7f5e080af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08147210 0x7f5e080af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 -- 172.21.15.167:0/3094090753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e08146d90 msgr2=0x7f5e080aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e08146d90 0x7f5e080aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.904+0000 7f5e06ffd640 1 -- 172.21.15.167:0/3094090753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080b4620 con 0x7f5df0003980 2024-09-13T17:20:26.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5e06ffd640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0003980 0x7f5e08070c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5df80ab040 tx=0x7f5df0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5deffff640 1 -- 172.21.15.167:0/3094090753 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8004c00 con 0x7f5df0003980 2024-09-13T17:20:26.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5deffff640 1 -- 172.21.15.167:0/3094090753 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df80b3070 con 0x7f5df0003980 2024-09-13T17:20:26.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e080b1eb0 con 0x7f5df0003980 2024-09-13T17:20:26.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5deffff640 1 -- 172.21.15.167:0/3094090753 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8001c90 con 0x7f5df0003980 2024-09-13T17:20:26.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e080aff60 con 0x7f5df0003980 2024-09-13T17:20:26.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5deffff640 1 -- 172.21.15.167:0/3094090753 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5df80070d0 con 0x7f5df0003980 2024-09-13T17:20:26.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.908+0000 7f5deffff640 1 -- 172.21.15.167:0/3094090753 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5df80b5070 con 0x7f5df0003980 2024-09-13T17:20:26.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.912+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e081459f0 con 0x7f5df0003980 2024-09-13T17:20:26.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.928+0000 7f5deffff640 1 -- 172.21.15.167:0/3094090753 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5df80d9e30 con 0x7f5df0003980 2024-09-13T17:20:26.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:26.992+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5e080b7aa0 con 0x7f5df0003980 2024-09-13T17:20:27.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5deffff640 1 -- 172.21.15.167:0/3094090753 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5df80c8020 con 0x7f5df0003980 2024-09-13T17:20:27.006 INFO:teuthology.orchestra.run.smithi167.stderr:adjusted tunables profile to default 2024-09-13T17:20:27.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0003980 msgr2=0x7f5e08070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0003980 0x7f5e08070c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5df80ab040 tx=0x7f5df0005800 comp rx=0 tx=0).stop 2024-09-13T17:20:27.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 shutdown_connections 2024-09-13T17:20:27.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e08147210 0x7f5e080af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e08146d90 0x7f5e080aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 --2- 172.21.15.167:0/3094090753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5df0003980 0x7f5e08070c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 >> 172.21.15.167:0/3094090753 conn(0x7f5e080b4db0 msgr2=0x7f5e08144a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:27.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 shutdown_connections 2024-09-13T17:20:27.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:27.004+0000 7f5e0d9e7640 1 -- 172.21.15.167:0/3094090753 wait complete. 2024-09-13T17:20:27.026 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T17:20:27.026 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T17:20:27.026 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:27.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T17:20:27.037 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:27.038 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T17:20:27.093 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:27.094 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T17:20:27.132 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:27.133+0000 7f7d282d8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:20:27.135 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:27.132+0000 7f2382f59180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:20:27.146 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:20:27.146 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T17:20:27.205 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:27.205 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T17:20:27.218 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:27.218 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T17:20:27.276 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:27.276 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T17:20:27.328 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-13T17:20:27.328 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T17:20:27.389 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new d6dc4b59-66e8-47ce-bef7-745e84b511d1 0 2024-09-13T17:20:27.555 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6eeba95640 1 Processor -- start 2024-09-13T17:20:27.555 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6eeba95640 1 -- start start 2024-09-13T17:20:27.556 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6eeba95640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee40ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.556 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6eeba95640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee41401d0 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.556 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6eeba95640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee40ae520 con 0x7f6ee409a690 2024-09-13T17:20:27.556 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6eeba95640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40b5a90 con 0x7f6ee40b56b0 2024-09-13T17:20:27.556 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6ee9831640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee40ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6ee9831640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee40ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:35514/0 (socket says 172.21.15.190:35514) 2024-09-13T17:20:27.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6eea032640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6ee409a690 0x7f6ee414cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:52808/0 (socket says 172.21.15.190:52808) 2024-09-13T17:20:27.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6ee9831640 1 -- 172.21.15.190:0/688071828 learned_addr learned my addr 172.21.15.190:0/688071828 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:27.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6ee882f640 1 -- 172.21.15.190:0/688071828 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292627100 0 0) 0x7f6ee40ae520 con 0x7f6ee409a690 2024-09-13T17:20:27.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6ee9831640 1 -- 172.21.15.190:0/688071828 >> v1:172.21.15.190:6789/0 conn(0x7f6ee409a690 legacy=0x7f6ee414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6ee9831640 1 -- 172.21.15.190:0/688071828 >> v1:172.21.15.167:6789/0 conn(0x7f6ee40ad7a0 legacy=0x7f6ee4145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.557 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.553+0000 7f6ee9831640 1 -- 172.21.15.190:0/688071828 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40ae9b0 con 0x7f6ee40b56b0 2024-09-13T17:20:27.558 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6ee9831640 1 --2- 172.21.15.190:0/688071828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee40ad260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009e80 tx=0x7f6edc01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac08319bebfa464 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:27.558 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6ee882f640 1 -- 172.21.15.190:0/688071828 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0a5760 con 0x7f6ee40b56b0 2024-09-13T17:20:27.558 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6ee882f640 1 -- 172.21.15.190:0/688071828 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc0a58c0 con 0x7f6ee40b56b0 2024-09-13T17:20:27.559 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6ee882f640 1 -- 172.21.15.190:0/688071828 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0a5c50 con 0x7f6ee40b56b0 2024-09-13T17:20:27.559 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 -- 172.21.15.190:0/688071828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 msgr2=0x7f6ee40ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.559 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 --2- 172.21.15.190:0/688071828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee40ad260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009e80 tx=0x7f6edc01c990 comp rx=0 tx=0).stop 2024-09-13T17:20:27.559 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 -- 172.21.15.190:0/688071828 shutdown_connections 2024-09-13T17:20:27.560 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 --2- 172.21.15.190:0/688071828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee40ad260 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.560 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 -- 172.21.15.190:0/688071828 >> 172.21.15.190:0/688071828 conn(0x7f6ee40b8840 msgr2=0x7f6ee40b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:27.560 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 -- 172.21.15.190:0/688071828 shutdown_connections 2024-09-13T17:20:27.560 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 -- 172.21.15.190:0/688071828 wait complete. 2024-09-13T17:20:27.563 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 Processor -- start 2024-09-13T17:20:27.563 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.557+0000 7f6eeba95640 1 -- start start 2024-09-13T17:20:27.563 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee409a690 0x7f6ee409b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.563 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee40ad7a0 0x7f6ee41e1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.563 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee409c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.563 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee409e0f0 con 0x7f6ee409a690 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee409d160 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee409d440 con 0x7f6ee40b56b0 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee40ad7a0 0x7f6ee41e1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eea032640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee40ad7a0 0x7f6ee41e1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40072/0 (socket says 172.21.15.190:40072) 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eea032640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee409c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:35522/0 (socket says 172.21.15.190:35522) 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 -- 172.21.15.190:0/2469168398 learned_addr learned my addr 172.21.15.190:0/2469168398 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9831640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee409a690 0x7f6ee409b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 -- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 msgr2=0x7f6ee409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee409c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 -- 172.21.15.190:0/2469168398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee409a690 msgr2=0x7f6ee409b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee409a690 0x7f6ee409b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 -- 172.21.15.190:0/2469168398 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc009b30 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eea032640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee409c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9831640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee409a690 0x7f6ee409b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6ee9030640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee40ad7a0 0x7f6ee41e1580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40adb80 tx=0x7f6ed400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eda7fc640 1 -- 172.21.15.190:0/2469168398 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40052d0 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eda7fc640 1 -- 172.21.15.190:0/2469168398 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4005430 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee409bcf0 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eda7fc640 1 -- 172.21.15.190:0/2469168398 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4003840 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee41e2270 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eda7fc640 1 -- 172.21.15.190:0/2469168398 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6ed4003ca0 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eda7fc640 1 -- 172.21.15.190:0/2469168398 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ed401c780 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.565 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.561+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee41e2490 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.566 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.565+0000 7f6eda7fc640 1 -- 172.21.15.190:0/2469168398 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6ed4017070 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.622 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:27.620+0000 7f2382f59180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:20:27.622 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:27.621+0000 7f7d282d8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:20:27.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.649+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6dc4b59-66e8-47ce-bef7-745e84b511d1", "id": 0} v 0) v1 -- 0x7f6ee40ad260 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.659 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.657+0000 7f6eda7fc640 1 -- 172.21.15.190:0/2469168398 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6dc4b59-66e8-47ce-bef7-745e84b511d1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ed4011630 con 0x7f6ee40ad7a0 2024-09-13T17:20:27.660 INFO:teuthology.orchestra.run.smithi190.stdout:0 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee40ad7a0 msgr2=0x7f6ee41e1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee40ad7a0 0x7f6ee41e1580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40adb80 tx=0x7f6ed400c890 comp rx=0 tx=0).stop 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 shutdown_connections 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ee40b56b0 0x7f6ee409c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee40ad7a0 0x7f6ee41e1580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 --2- 172.21.15.190:0/2469168398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee409a690 0x7f6ee409b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 >> 172.21.15.190:0/2469168398 conn(0x7f6ee40b8840 msgr2=0x7f6ee40b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 shutdown_connections 2024-09-13T17:20:27.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.661+0000 7f6eeba95640 1 -- 172.21.15.190:0/2469168398 wait complete. 2024-09-13T17:20:27.676 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 92e638ce-2e11-4362-95d0-913694724465 1 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ae5e2a640 1 Processor -- start 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ae5e2a640 1 -- start start 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ae5e2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae0146100 0x7f0ae01465b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ae5e2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae00ad2d0 con 0x7f0ae006a1e0 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ae5e2a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae00ae870 con 0x7f0ae00ad760 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ae5e2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00b4340 con 0x7f0ae0146100 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0adffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae0146100 0x7f0ae01465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ad7fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0ae00ad760 0x7f0ae01459f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:52820/0 (socket says 172.21.15.190:52820) 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0ad7fff640 1 -- 172.21.15.190:0/2885475334 learned_addr learned my addr 172.21.15.190:0/2885475334 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-13T17:20:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0adffff640 1 -- 172.21.15.190:0/2885475334 >> v1:172.21.15.190:6789/0 conn(0x7f0ae00ad760 legacy=0x7f0ae01459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0adffff640 1 -- 172.21.15.190:0/2885475334 >> v1:172.21.15.167:6789/0 conn(0x7f0ae006a1e0 legacy=0x7f0ae00aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0adeffd640 1 -- 172.21.15.190:0/2885475334 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517170934 0 0) 0x7f0ae00ae870 con 0x7f0ae00ad760 2024-09-13T17:20:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.793+0000 7f0adffff640 1 -- 172.21.15.190:0/2885475334 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae006a5c0 con 0x7f0ae0146100 2024-09-13T17:20:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0adffff640 1 --2- 172.21.15.190:0/2885475334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae0146100 0x7f0ae01465b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009dc0 tx=0x7f0ad801c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d0defd9a7cd8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0adeffd640 1 -- 172.21.15.190:0/2885475334 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80a5820 con 0x7f0ae0146100 2024-09-13T17:20:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0adeffd640 1 -- 172.21.15.190:0/2885475334 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad80a5980 con 0x7f0ae0146100 2024-09-13T17:20:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0adeffd640 1 -- 172.21.15.190:0/2885475334 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80a5d10 con 0x7f0ae0146100 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/2885475334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae0146100 msgr2=0x7f0ae01465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 --2- 172.21.15.190:0/2885475334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae0146100 0x7f0ae01465b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009dc0 tx=0x7f0ad801c870 comp rx=0 tx=0).stop 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/2885475334 shutdown_connections 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 --2- 172.21.15.190:0/2885475334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae0146100 0x7f0ae01465b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/2885475334 >> 172.21.15.190:0/2885475334 conn(0x7f0ae00b4db0 msgr2=0x7f0ae00b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/2885475334 shutdown_connections 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/2885475334 wait complete. 2024-09-13T17:20:27.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 Processor -- start 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- start start 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae006a1e0 0x7f0ae00b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae00ad760 0x7f0ae009ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae0146100 0x7f0ae009d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae01474b0 con 0x7f0ae0146100 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae009ca20 con 0x7f0ae006a1e0 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0ae5e2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae009e020 con 0x7f0ae00ad760 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.797+0000 7f0adf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae006a1e0 0x7f0ae00b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ad7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae00ad760 0x7f0ae009ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae006a1e0 0x7f0ae00b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40078/0 (socket says 172.21.15.190:40078) 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adf7fe640 1 -- 172.21.15.190:0/212195613 learned_addr learned my addr 172.21.15.190:0/212195613 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adffff640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae0146100 0x7f0ae009d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ad7fff640 1 -- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae006a1e0 msgr2=0x7f0ae00b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ad7fff640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae006a1e0 0x7f0ae00b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ad7fff640 1 -- 172.21.15.190:0/212195613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae0146100 msgr2=0x7f0ae009d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ad7fff640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae0146100 0x7f0ae009d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ad7fff640 1 -- 172.21.15.190:0/212195613 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad8009a70 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adf7fe640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae006a1e0 0x7f0ae00b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ad7fff640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae00ad760 0x7f0ae009ceb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c450 tx=0x7f0ac800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adcff9640 1 -- 172.21.15.190:0/212195613 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80074e0 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adcff9640 1 -- 172.21.15.190:0/212195613 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8007640 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae0147bc0 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adcff9640 1 -- 172.21.15.190:0/212195613 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8004a30 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae00b1a70 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adcff9640 1 -- 172.21.15.190:0/212195613 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0ac801d440 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0adcff9640 1 -- 172.21.15.190:0/212195613 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0ac80127b0 con 0x7f0ae00ad760 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.801+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae01465b0 con 0x7f0ae00ad760 2024-09-13T17:20:27.805 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.805+0000 7f0adcff9640 1 -- 172.21.15.190:0/212195613 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0ac8018070 con 0x7f0ae00ad760 2024-09-13T17:20:27.831 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:27.828+0000 7f2382f59180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:20:27.840 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:27.837+0000 7f7d282d8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:20:27.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.873+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "92e638ce-2e11-4362-95d0-913694724465", "id": 1} v 0) v1 -- 0x7f0ae006f6e0 con 0x7f0ae00ad760 2024-09-13T17:20:27.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.877+0000 7f0adcff9640 1 -- 172.21.15.190:0/212195613 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92e638ce-2e11-4362-95d0-913694724465", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ac8012af0 con 0x7f0ae00ad760 2024-09-13T17:20:27.880 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae00ad760 msgr2=0x7f0ae009ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae00ad760 0x7f0ae009ceb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c450 tx=0x7f0ac800c910 comp rx=0 tx=0).stop 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 shutdown_connections 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae0146100 0x7f0ae009d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ae00ad760 0x7f0ae009ceb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 --2- 172.21.15.190:0/212195613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ae006a1e0 0x7f0ae00b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 >> 172.21.15.190:0/212195613 conn(0x7f0ae00b4db0 msgr2=0x7f0ae0098a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 shutdown_connections 2024-09-13T17:20:27.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:27.881+0000 7f0ae5e2a640 1 -- 172.21.15.190:0/212195613 wait complete. 2024-09-13T17:20:27.899 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new a03410c0-ce29-4b7a-b100-decbc285afbb 2 2024-09-13T17:20:28.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b79ad640 1 Processor -- start 2024-09-13T17:20:28.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b79ad640 1 -- start start 2024-09-13T17:20:28.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b79ad640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd6b00b43e0 0x7fd6b006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b79ad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b01407d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b79ad640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b006dd40 con 0x7fd6b0140d10 2024-09-13T17:20:28.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b79ad640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b00b4c90 con 0x7fd6b00b43e0 2024-09-13T17:20:28.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b79ad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b006dad0 con 0x7fd6b0144220 2024-09-13T17:20:28.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b5f4a640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd6b0140d10 0x7fd6b0146df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:52822/0 (socket says 172.21.15.190:52822) 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b4f48640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b01407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b5f4a640 1 -- 172.21.15.190:0/2441104051 learned_addr learned my addr 172.21.15.190:0/2441104051 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b5749640 1 --2- 172.21.15.190:0/2441104051 >> v2:172.21.15.167:3300/0 conn(0x7fd6b00b43e0 0x7fd6b006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6a7fff640 1 -- 172.21.15.190:0/2441104051 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165061281 0 0) 0x7fd6b006dd40 con 0x7fd6b0140d10 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6a7fff640 1 -- 172.21.15.190:0/2441104051 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd69c003530 con 0x7fd6b0140d10 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b4f48640 1 -- 172.21.15.190:0/2441104051 >> v2:172.21.15.167:3300/0 conn(0x7fd6b00b43e0 msgr2=0x7fd6b006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b4f48640 1 --2- 172.21.15.190:0/2441104051 >> v2:172.21.15.167:3300/0 conn(0x7fd6b00b43e0 0x7fd6b006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b4f48640 1 -- 172.21.15.190:0/2441104051 >> v1:172.21.15.190:6789/0 conn(0x7fd6b0140d10 legacy=0x7fd6b0146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.012 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.009+0000 7fd6b4f48640 1 -- 172.21.15.190:0/2441104051 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0143a20 con 0x7fd6b0144220 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b4f48640 1 --2- 172.21.15.190:0/2441104051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b01407d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00097c0 tx=0x7fd6a001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=747a09519e0d25c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a7fff640 1 -- 172.21.15.190:0/2441104051 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00ab600 con 0x7fd6b0144220 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a7fff640 1 -- 172.21.15.190:0/2441104051 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a00a7050 con 0x7fd6b0144220 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a7fff640 1 -- 172.21.15.190:0/2441104051 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00ab980 con 0x7fd6b0144220 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- 172.21.15.190:0/2441104051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 msgr2=0x7fd6b01407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 --2- 172.21.15.190:0/2441104051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b01407d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00097c0 tx=0x7fd6a001c3e0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- 172.21.15.190:0/2441104051 shutdown_connections 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 --2- 172.21.15.190:0/2441104051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b01407d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 --2- 172.21.15.190:0/2441104051 >> v2:172.21.15.167:3300/0 conn(0x7fd6b00b43e0 0x7fd6b006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- 172.21.15.190:0/2441104051 >> 172.21.15.190:0/2441104051 conn(0x7fd6b009b150 msgr2=0x7fd6b009b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- 172.21.15.190:0/2441104051 shutdown_connections 2024-09-13T17:20:28.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- 172.21.15.190:0/2441104051 wait complete. 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 Processor -- start 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- start start 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6b00b43e0 0x7fd6b009a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6b0140d10 0x7fd6b009e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b009d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b013e230 con 0x7fd6b00b43e0 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b009c450 con 0x7fd6b0140d10 2024-09-13T17:20:28.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b0145ec0 con 0x7fd6b0144220 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b4f48640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6b0140d10 0x7fd6b009e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b009d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b009d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:35570/0 (socket says 172.21.15.190:35570) 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 -- 172.21.15.190:0/883480372 learned_addr learned my addr 172.21.15.190:0/883480372 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b4f48640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6b0140d10 0x7fd6b009e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40088/0 (socket says 172.21.15.190:40088) 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5749640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6b00b43e0 0x7fd6b009a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 -- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6b0140d10 msgr2=0x7fd6b009e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6b0140d10 0x7fd6b009e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 -- 172.21.15.190:0/883480372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6b00b43e0 msgr2=0x7fd6b009a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6b00b43e0 0x7fd6b009a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 -- 172.21.15.190:0/883480372 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0009420 con 0x7fd6b0144220 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b4f48640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6b0140d10 0x7fd6b009e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:28.018 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b5f4a640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b009d560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800cb40 tx=0x7fd6a800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a5ffb640 1 -- 172.21.15.190:0/883480372 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800aca0 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a5ffb640 1 -- 172.21.15.190:0/883480372 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a800ae00 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b009ec00 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a5ffb640 1 -- 172.21.15.190:0/883480372 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8012620 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b009c6a0 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a5ffb640 1 -- 172.21.15.190:0/883480372 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd6a8012a80 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.013+0000 7fd6a5ffb640 1 -- 172.21.15.190:0/883480372 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd6a8007490 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.017+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b00708f0 con 0x7fd6b0144220 2024-09-13T17:20:28.019 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.017+0000 7fd6a5ffb640 1 -- 172.21.15.190:0/883480372 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd6a8017070 con 0x7fd6b0144220 2024-09-13T17:20:28.086 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.085+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a03410c0-ce29-4b7a-b100-decbc285afbb", "id": 2} v 0) v1 -- 0x7fd6b0140af0 con 0x7fd6b0144220 2024-09-13T17:20:28.093 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6a5ffb640 1 -- 172.21.15.190:0/883480372 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a03410c0-ce29-4b7a-b100-decbc285afbb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd6a8007140 con 0x7fd6b0144220 2024-09-13T17:20:28.094 INFO:teuthology.orchestra.run.smithi190.stdout:2 2024-09-13T17:20:28.095 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 msgr2=0x7fd6b009d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.095 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b009d560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800cb40 tx=0x7fd6a800a060 comp rx=0 tx=0).stop 2024-09-13T17:20:28.095 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 shutdown_connections 2024-09-13T17:20:28.095 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6b0144220 0x7fd6b009d560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.095 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6b0140d10 0x7fd6b009e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.095 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 --2- 172.21.15.190:0/883480372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6b00b43e0 0x7fd6b009a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.095 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 >> 172.21.15.190:0/883480372 conn(0x7fd6b009b150 msgr2=0x7fd6b01417f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.096 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 shutdown_connections 2024-09-13T17:20:28.096 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.093+0000 7fd6b79ad640 1 -- 172.21.15.190:0/883480372 wait complete. 2024-09-13T17:20:28.110 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new c357ebd5-40d7-4b7b-a7b3-cd4df1443393 3 2024-09-13T17:20:28.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b39aad640 1 Processor -- start 2024-09-13T17:20:28.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b39aad640 1 -- start start 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b39aad640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b3409bdc0 0x7f0b34146650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b39aad640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b340ad9d0 con 0x7f0b340b7a50 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b39aad640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b340ae9d0 con 0x7f0b340ad5f0 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b39aad640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3406c9b0 con 0x7f0b3409bdc0 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b337fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0b340ad5f0 0x7f0b3409b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:52834/0 (socket says 172.21.15.190:52834) 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b337fe640 1 -- 172.21.15.190:0/1644145878 learned_addr learned my addr 172.21.15.190:0/1644145878 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b33fff640 1 --2- 172.21.15.190:0/1644145878 >> v2:172.21.15.167:3300/0 conn(0x7f0b3409bdc0 0x7f0b34146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947222247 0 0) 0x7f0b340ae9d0 con 0x7f0b340ad5f0 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1c003530 con 0x7f0b340ad5f0 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15941293 0 0) 0x7f0b1c003530 con 0x7f0b340ad5f0 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 >> v2:172.21.15.167:3300/0 conn(0x7f0b3409bdc0 msgr2=0x7f0b34146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 --2- 172.21.15.190:0/1644145878 >> v2:172.21.15.167:3300/0 conn(0x7f0b3409bdc0 0x7f0b34146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 >> v1:172.21.15.167:6789/0 conn(0x7f0b340b7a50 legacy=0x7f0b34145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3406cc90 con 0x7f0b340ad5f0 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f0b24001680 con 0x7f0b340ad5f0 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 >> v1:172.21.15.190:6789/0 conn(0x7f0b340ad5f0 legacy=0x7f0b3409b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b1c003980 0x7f0b1c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.225+0000 7f0b327fc640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c0047d0 0x7f0b1c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b327fc640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b1c005190 0x7f0b1c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3406c9b0 con 0x7f0b1c003980 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c00c030 con 0x7f0b1c0047d0 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c00c1f0 con 0x7f0b1c005190 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b32ffd640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c0047d0 0x7f0b1c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b1c005190 0x7f0b1c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b337fe640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b1c003980 0x7f0b1c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 -- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c0047d0 msgr2=0x7f0b1c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c0047d0 0x7f0b1c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 -- 172.21.15.190:0/1644145878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b1c003980 msgr2=0x7f0b1c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b1c003980 0x7f0b1c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 -- 172.21.15.190:0/1644145878 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c003530 con 0x7f0b1c005190 2024-09-13T17:20:28.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b32ffd640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c0047d0 0x7f0b1c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 -- 172.21.15.190:0/1644145878 reap_dead start 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b33fff640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b1c005190 0x7f0b1c00b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009fc0 tx=0x7f0b2c01ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ee3a88acd314c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0a5bf0 con 0x7f0b1c005190 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c00f040 con 0x7f0b1c005190 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b327fc640 1 -- 172.21.15.190:0/1644145878 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0039a0 con 0x7f0b1c005190 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b39aad640 1 -- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b1c005190 msgr2=0x7f0b1c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b39aad640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b1c005190 0x7f0b1c00b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009fc0 tx=0x7f0b2c01ccc0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b39aad640 1 -- 172.21.15.190:0/1644145878 shutdown_connections 2024-09-13T17:20:28.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b39aad640 1 --2- 172.21.15.190:0/1644145878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b1c005190 0x7f0b1c00b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b39aad640 1 -- 172.21.15.190:0/1644145878 >> 172.21.15.190:0/1644145878 conn(0x7f0b3406b9d0 msgr2=0x7f0b340b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b39aad640 1 -- 172.21.15.190:0/1644145878 shutdown_connections 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.229+0000 7f0b39aad640 1 -- 172.21.15.190:0/1644145878 wait complete. 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 Processor -- start 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 -- start start 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c005190 0x7f0b3413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b3413f170 0x7f0b341408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b34140e00 0x7f0b341dee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b34141280 con 0x7f0b3413f170 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3413b580 con 0x7f0b1c005190 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3413f710 con 0x7f0b34140e00 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c005190 0x7f0b3413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c005190 0x7f0b3413ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40112/0 (socket says 172.21.15.190:40112) 2024-09-13T17:20:28.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 -- 172.21.15.190:0/2274092000 learned_addr learned my addr 172.21.15.190:0/2274092000 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b33fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b34140e00 0x7f0b341dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b32ffd640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b3413f170 0x7f0b341408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 -- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b34140e00 msgr2=0x7f0b341dee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b34140e00 0x7f0b341dee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 -- 172.21.15.190:0/2274092000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b3413f170 msgr2=0x7f0b341408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b3413f170 0x7f0b341408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 -- 172.21.15.190:0/2274092000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b341400c0 con 0x7f0b1c005190 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b32ffd640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b3413f170 0x7f0b341408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b33fff640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b34140e00 0x7f0b341dee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b337fe640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c005190 0x7f0b3413ec30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b24007320 tx=0x7f0b24007720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b1bfff640 1 -- 172.21.15.190:0/2274092000 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400fa00 con 0x7f0b1c005190 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b1bfff640 1 -- 172.21.15.190:0/2274092000 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2400fb60 con 0x7f0b1c005190 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b341403a0 con 0x7f0b1c005190 2024-09-13T17:20:28.238 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b1bfff640 1 -- 172.21.15.190:0/2274092000 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240133f0 con 0x7f0b1c005190 2024-09-13T17:20:28.239 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3409a7f0 con 0x7f0b1c005190 2024-09-13T17:20:28.239 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b1bfff640 1 -- 172.21.15.190:0/2274092000 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0b24013850 con 0x7f0b1c005190 2024-09-13T17:20:28.239 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b1bfff640 1 -- 172.21.15.190:0/2274092000 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0b2401dcb0 con 0x7f0b1c005190 2024-09-13T17:20:28.239 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.233+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3406fa70 con 0x7f0b1c005190 2024-09-13T17:20:28.239 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.237+0000 7f0b1bfff640 1 -- 172.21.15.190:0/2274092000 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0b24013c40 con 0x7f0b1c005190 2024-09-13T17:20:28.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.301+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c357ebd5-40d7-4b7b-a7b3-cd4df1443393", "id": 3} v 0) v1 -- 0x7f0b3409a9e0 con 0x7f0b1c005190 2024-09-13T17:20:28.312 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.309+0000 7f0b1bfff640 1 -- 172.21.15.190:0/2274092000 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c357ebd5-40d7-4b7b-a7b3-cd4df1443393", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b2402c0b0 con 0x7f0b1c005190 2024-09-13T17:20:28.312 INFO:teuthology.orchestra.run.smithi190.stdout:3 2024-09-13T17:20:28.313 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c005190 msgr2=0x7f0b3413ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c005190 0x7f0b3413ec30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b24007320 tx=0x7f0b24007720 comp rx=0 tx=0).stop 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 shutdown_connections 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b34140e00 0x7f0b341dee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b3413f170 0x7f0b341408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 --2- 172.21.15.190:0/2274092000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b1c005190 0x7f0b3413ec30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 >> 172.21.15.190:0/2274092000 conn(0x7f0b3406b9d0 msgr2=0x7f0b340b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 shutdown_connections 2024-09-13T17:20:28.314 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.313+0000 7f0b39aad640 1 -- 172.21.15.190:0/2274092000 wait complete. 2024-09-13T17:20:28.329 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 4246b7d4-5804-4f9f-aa06-344f27b85664 4 2024-09-13T17:20:28.385 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.380+0000 7f2382f59180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:20:28.411 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.409+0000 7f7d282d8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:20:28.439 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.436+0000 7f2382f59180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:20:28.443 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb21bd41640 1 Processor -- start 2024-09-13T17:20:28.443 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb21bd41640 1 -- start start 2024-09-13T17:20:28.444 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb21bd41640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb21406e890 0x7fb214145a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.444 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb21bd41640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140b3da0 con 0x7fb21406d7f0 2024-09-13T17:20:28.444 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb21bd41640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140b4640 con 0x7fb214145fa0 2024-09-13T17:20:28.444 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb21bd41640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140b5760 con 0x7fb21406e890 2024-09-13T17:20:28.444 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb2192dc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb21406e890 0x7fb214145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb2192dc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb21406e890 0x7fb214145a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40128/0 (socket says 172.21.15.190:40128) 2024-09-13T17:20:28.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb21a2de640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb214145fa0 0x7fb214150300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:52846/0 (socket says 172.21.15.190:52846) 2024-09-13T17:20:28.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb2192dc640 1 -- 172.21.15.190:0/3936728989 learned_addr learned my addr 172.21.15.190:0/3936728989 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:28.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb2192dc640 1 -- 172.21.15.190:0/3936728989 >> v1:172.21.15.190:6789/0 conn(0x7fb214145fa0 legacy=0x7fb214150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb2192dc640 1 -- 172.21.15.190:0/3936728989 >> v1:172.21.15.167:6789/0 conn(0x7fb21406d7f0 legacy=0x7fb214142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.441+0000 7fb2192dc640 1 -- 172.21.15.190:0/3936728989 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214072290 con 0x7fb21406e890 2024-09-13T17:20:28.446 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb2192dc640 1 --2- 172.21.15.190:0/3936728989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406e890 0x7fb214145a60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb204009870 tx=0x7fb20401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac90fda213ed592 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.446 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb218adb640 1 -- 172.21.15.190:0/3936728989 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040ab600 con 0x7fb21406e890 2024-09-13T17:20:28.446 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb218adb640 1 -- 172.21.15.190:0/3936728989 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2040a7050 con 0x7fb21406e890 2024-09-13T17:20:28.447 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb218adb640 1 -- 172.21.15.190:0/3936728989 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040ab980 con 0x7fb21406e890 2024-09-13T17:20:28.447 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 -- 172.21.15.190:0/3936728989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406e890 msgr2=0x7fb214145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.447 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 --2- 172.21.15.190:0/3936728989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406e890 0x7fb214145a60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb204009870 tx=0x7fb20401c440 comp rx=0 tx=0).stop 2024-09-13T17:20:28.447 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 -- 172.21.15.190:0/3936728989 shutdown_connections 2024-09-13T17:20:28.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 --2- 172.21.15.190:0/3936728989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406e890 0x7fb214145a60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 -- 172.21.15.190:0/3936728989 >> 172.21.15.190:0/3936728989 conn(0x7fb21409b150 msgr2=0x7fb21409b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 -- 172.21.15.190:0/3936728989 shutdown_connections 2024-09-13T17:20:28.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 -- 172.21.15.190:0/3936728989 wait complete. 2024-09-13T17:20:28.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 Processor -- start 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.445+0000 7fb21bd41640 1 -- start start 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406d7f0 0x7fb2141df200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb21406e890 0x7fb21406bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb214145fa0 0x7fb2141e2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2141ded70 con 0x7fb214145fa0 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214139af0 con 0x7fb21406d7f0 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2141dea00 con 0x7fb21406e890 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb21406e890 0x7fb21406bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb219add640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406d7f0 0x7fb2141df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb21406e890 0x7fb21406bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:35592/0 (socket says 172.21.15.190:35592) 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 -- 172.21.15.190:0/2229490183 learned_addr learned my addr 172.21.15.190:0/2229490183 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21a2de640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb214145fa0 0x7fb2141e2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 -- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406d7f0 msgr2=0x7fb2141df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406d7f0 0x7fb2141df200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 -- 172.21.15.190:0/2229490183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb214145fa0 msgr2=0x7fb2141e2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb214145fa0 0x7fb2141e2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 -- 172.21.15.190:0/2229490183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040094d0 con 0x7fb21406e890 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb219add640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406d7f0 0x7fb2141df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb2192dc640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb21406e890 0x7fb21406bb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb2040ae040 tx=0x7fb2040191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb20a7fc640 1 -- 172.21.15.190:0/2229490183 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040b4850 con 0x7fb21406e890 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb20a7fc640 1 -- 172.21.15.190:0/2229490183 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2040b49d0 con 0x7fb21406e890 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb20a7fc640 1 -- 172.21.15.190:0/2229490183 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040b4d80 con 0x7fb21406e890 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2141df740 con 0x7fb21406e890 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21406c5f0 con 0x7fb21406e890 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb20a7fc640 1 -- 172.21.15.190:0/2229490183 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb2040b2070 con 0x7fb21406e890 2024-09-13T17:20:28.452 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb20a7fc640 1 -- 172.21.15.190:0/2229490183 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb2040b38b0 con 0x7fb21406e890 2024-09-13T17:20:28.453 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.449+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb214145a60 con 0x7fb21406e890 2024-09-13T17:20:28.453 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.453+0000 7fb20a7fc640 1 -- 172.21.15.190:0/2229490183 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb2040dbe30 con 0x7fb21406e890 2024-09-13T17:20:28.478 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.477+0000 7f7d282d8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:20:28.491 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.488+0000 7f2382f59180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:20:28.533 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.533+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4246b7d4-5804-4f9f-aa06-344f27b85664", "id": 4} v 0) v1 -- 0x7fb21406e580 con 0x7fb21406e890 2024-09-13T17:20:28.534 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.533+0000 7f7d282d8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:20:28.540 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb20a7fc640 1 -- 172.21.15.190:0/2229490183 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4246b7d4-5804-4f9f-aa06-344f27b85664", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb2040ca030 con 0x7fb21406e890 2024-09-13T17:20:28.540 INFO:teuthology.orchestra.run.smithi190.stdout:4 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb21406e890 msgr2=0x7fb21406bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb21406e890 0x7fb21406bb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb2040ae040 tx=0x7fb2040191e0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 shutdown_connections 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb214145fa0 0x7fb2141e2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb21406e890 0x7fb21406bb80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 --2- 172.21.15.190:0/2229490183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb21406d7f0 0x7fb2141df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 >> 172.21.15.190:0/2229490183 conn(0x7fb21409b150 msgr2=0x7fb2140afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 shutdown_connections 2024-09-13T17:20:28.542 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.541+0000 7fb21bd41640 1 -- 172.21.15.190:0/2229490183 wait complete. 2024-09-13T17:20:28.557 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new df1652a6-129c-46ca-9cea-93687e8e3cc2 5 2024-09-13T17:20:28.568 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.564+0000 7f2382f59180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:20:28.617 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.617+0000 7f7d282d8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:20:28.619 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.616+0000 7f2382f59180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:20:28.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f476b9cb640 1 Processor -- start 2024-09-13T17:20:28.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f476b9cb640 1 -- start start 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f476b9cb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f476413fda0 0x7f4764151250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f476b9cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640717a0 con 0x7f4764065f40 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f476b9cb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764066320 con 0x7f476406d320 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f476b9cb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640709e0 con 0x7f476413fda0 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f4768f66640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f476406d320 0x7f476413f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:52850/0 (socket says 172.21.15.190:52850) 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f4768f66640 1 -- 172.21.15.190:0/2818497741 learned_addr learned my addr 172.21.15.190:0/2818497741 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f4769f68640 1 --2- 172.21.15.190:0/2818497741 >> v2:172.21.15.167:3300/0 conn(0x7f476413fda0 0x7f4764151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839192035 0 0) 0x7f4764066320 con 0x7f476406d320 2024-09-13T17:20:28.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4750003530 con 0x7f476406d320 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 45131574 0 0) 0x7f4750003530 con 0x7f476406d320 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 >> v2:172.21.15.167:3300/0 conn(0x7f476413fda0 msgr2=0x7f4764151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 --2- 172.21.15.190:0/2818497741 >> v2:172.21.15.167:3300/0 conn(0x7f476413fda0 0x7f4764151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 >> v1:172.21.15.167:6789/0 conn(0x7f4764065f40 legacy=0x7f476406f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764071150 con 0x7f476406d320 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f4754001680 con 0x7f476406d320 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 >> v1:172.21.15.190:6789/0 conn(0x7f476406d320 legacy=0x7f476413f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4750003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4750004380 0x7f4750004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47500050f0 0x7f475000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640709e0 con 0x7f4750004380 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475000c030 con 0x7f4750003980 2024-09-13T17:20:28.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475000c1f0 con 0x7f47500050f0 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f4769767640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4750003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f4769f68640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47500050f0 0x7f475000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.661+0000 7f4768f66640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4750004380 0x7f4750004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f4769767640 1 -- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47500050f0 msgr2=0x7f475000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f4769767640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47500050f0 0x7f475000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f4769767640 1 -- 172.21.15.190:0/2818497741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4750004380 msgr2=0x7f4750004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f4769767640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4750004380 0x7f4750004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f4769767640 1 -- 172.21.15.190:0/2818497741 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750003530 con 0x7f4750003980 2024-09-13T17:20:28.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f4769f68640 1 -- 172.21.15.190:0/2818497741 reap_dead start 2024-09-13T17:20:28.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f4769767640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4750003d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4760001860 tx=0x7f476001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=800cb327835b4ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47600a8890 con 0x7f4750003980 2024-09-13T17:20:28.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47600a89f0 con 0x7f4750003980 2024-09-13T17:20:28.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f475bfff640 1 -- 172.21.15.190:0/2818497741 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47600a8de0 con 0x7f4750003980 2024-09-13T17:20:28.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f476b9cb640 1 -- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 msgr2=0x7f4750003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f476b9cb640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4750003d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4760001860 tx=0x7f476001ec70 comp rx=0 tx=0).stop 2024-09-13T17:20:28.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f476b9cb640 1 -- 172.21.15.190:0/2818497741 shutdown_connections 2024-09-13T17:20:28.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f476b9cb640 1 --2- 172.21.15.190:0/2818497741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4750003d60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f476b9cb640 1 -- 172.21.15.190:0/2818497741 >> 172.21.15.190:0/2818497741 conn(0x7f47640b5960 msgr2=0x7f47640b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f476b9cb640 1 -- 172.21.15.190:0/2818497741 shutdown_connections 2024-09-13T17:20:28.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.665+0000 7f476b9cb640 1 -- 172.21.15.190:0/2818497741 wait complete. 2024-09-13T17:20:28.671 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 Processor -- start 2024-09-13T17:20:28.671 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 -- start start 2024-09-13T17:20:28.671 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4764137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.671 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47641344b0 0x7f4764139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.671 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47641de600 0x7f47641dea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.671 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47641354e0 con 0x7f47641de600 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476413b910 con 0x7f4750003980 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764133790 con 0x7f47641344b0 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4764137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4768f66640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47641344b0 0x7f4764139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4764137790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40148/0 (socket says 172.21.15.190:40148) 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 -- 172.21.15.190:0/1901681356 learned_addr learned my addr 172.21.15.190:0/1901681356 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769f68640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47641de600 0x7f47641dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 -- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47641344b0 msgr2=0x7f4764139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47641344b0 0x7f4764139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 -- 172.21.15.190:0/1901681356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47641de600 msgr2=0x7f47641dea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47641de600 0x7f47641dea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 -- 172.21.15.190:0/1901681356 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476413a1e0 con 0x7f4750003980 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4768f66640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47641344b0 0x7f4764139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:28.672 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4769767640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4764137790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47600b3040 tx=0x7f4750005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4759ffb640 1 -- 172.21.15.190:0/1901681356 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47600a8890 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4759ffb640 1 -- 172.21.15.190:0/1901681356 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47600069e0 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4764135c50 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4759ffb640 1 -- 172.21.15.190:0/1901681356 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760006d50 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47641350e0 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4759ffb640 1 -- 172.21.15.190:0/1901681356 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f47600b7040 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476413bad0 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.669+0000 7f4759ffb640 1 -- 172.21.15.190:0/1901681356 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f47600b0c40 con 0x7f4750003980 2024-09-13T17:20:28.673 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.673+0000 7f7d282d8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:20:28.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.673+0000 7f4759ffb640 1 -- 172.21.15.190:0/1901681356 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f47600b5070 con 0x7f4750003980 2024-09-13T17:20:28.696 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.692+0000 7f2382f59180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:20:28.736 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.733+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df1652a6-129c-46ca-9cea-93687e8e3cc2", "id": 5} v 0) v1 -- 0x7f476413fa20 con 0x7f4750003980 2024-09-13T17:20:28.745 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f4759ffb640 1 -- 172.21.15.190:0/1901681356 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df1652a6-129c-46ca-9cea-93687e8e3cc2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47600d20b0 con 0x7f4750003980 2024-09-13T17:20:28.745 INFO:teuthology.orchestra.run.smithi190.stdout:5 2024-09-13T17:20:28.746 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 msgr2=0x7f4764137790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4764137790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47600b3040 tx=0x7f4750005800 comp rx=0 tx=0).stop 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 shutdown_connections 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47641de600 0x7f47641dea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47641344b0 0x7f4764139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 --2- 172.21.15.190:0/1901681356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750003980 0x7f4764137790 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 >> 172.21.15.190:0/1901681356 conn(0x7f47640b5960 msgr2=0x7f476406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 shutdown_connections 2024-09-13T17:20:28.747 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.745+0000 7f476b9cb640 1 -- 172.21.15.190:0/1901681356 wait complete. 2024-09-13T17:20:28.747 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.744+0000 7f2382f59180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:20:28.753 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.753+0000 7f7d282d8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:20:28.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 74655c1c-585c-4d21-99d7-66ef2600bcaa 6 2024-09-13T17:20:28.807 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.805+0000 7f7d282d8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:20:28.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1ade08640 1 Processor -- start 2024-09-13T17:20:28.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1ade08640 1 -- start start 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1ade08640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1a80b56b0 0x7fe1a80aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1ade08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1ade08640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a80ad970 con 0x7fe1a813f6a0 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1ade08640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a80adb40 con 0x7fe1a80b56b0 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1ade08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80ae800 con 0x7fe1a81497c0 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1a77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1a80b56b0 0x7fe1a80aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1a77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1a80b56b0 0x7fe1a80aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40164/0 (socket says 172.21.15.190:40164) 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a813fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:35612/0 (socket says 172.21.15.190:35612) 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.873+0000 7fe1a77fe640 1 -- 172.21.15.190:0/3969908636 learned_addr learned my addr 172.21.15.190:0/3969908636 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a7fff640 1 -- 172.21.15.190:0/3969908636 >> v2:172.21.15.190:3300/0 conn(0x7fe1a80b56b0 msgr2=0x7fe1a80aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:28.877 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a7fff640 1 --2- 172.21.15.190:0/3969908636 >> v2:172.21.15.190:3300/0 conn(0x7fe1a80b56b0 0x7fe1a80aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.878 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a7fff640 1 -- 172.21.15.190:0/3969908636 >> v1:172.21.15.167:6789/0 conn(0x7fe1a813f6a0 legacy=0x7fe1a81490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.878 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a7fff640 1 -- 172.21.15.190:0/3969908636 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80b5a90 con 0x7fe1a81497c0 2024-09-13T17:20:28.878 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a77fe640 1 --2- 172.21.15.190:0/3969908636 >> v2:172.21.15.190:3300/0 conn(0x7fe1a80b56b0 0x7fe1a80aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:28.879 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a7fff640 1 --2- 172.21.15.190:0/3969908636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a813fac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00097c0 tx=0x7fe1a001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f89e367ed7092c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.879 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a67fc640 1 -- 172.21.15.190:0/3969908636 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00a4ea0 con 0x7fe1a81497c0 2024-09-13T17:20:28.879 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a67fc640 1 -- 172.21.15.190:0/3969908636 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a00a7050 con 0x7fe1a81497c0 2024-09-13T17:20:28.879 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1a67fc640 1 -- 172.21.15.190:0/3969908636 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00ab820 con 0x7fe1a81497c0 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 -- 172.21.15.190:0/3969908636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 msgr2=0x7fe1a813fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 --2- 172.21.15.190:0/3969908636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a813fac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00097c0 tx=0x7fe1a001c410 comp rx=0 tx=0).stop 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 -- 172.21.15.190:0/3969908636 shutdown_connections 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 --2- 172.21.15.190:0/3969908636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a813fac0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 --2- 172.21.15.190:0/3969908636 >> v2:172.21.15.190:3300/0 conn(0x7fe1a80b56b0 0x7fe1a80aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 -- 172.21.15.190:0/3969908636 >> 172.21.15.190:0/3969908636 conn(0x7fe1a80b8840 msgr2=0x7fe1a80b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 -- 172.21.15.190:0/3969908636 shutdown_connections 2024-09-13T17:20:28.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.877+0000 7fe1ade08640 1 -- 172.21.15.190:0/3969908636 wait complete. 2024-09-13T17:20:28.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 Processor -- start 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 -- start start 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1a80b56b0 0x7fe1a8070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1a813f6a0 0x7fe1a81dddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a81e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80b0490 con 0x7fe1a80b56b0 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8145f20 con 0x7fe1a813f6a0 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8145c20 con 0x7fe1a81497c0 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a81e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a6ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1a813f6a0 0x7fe1a81dddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a81e1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:35614/0 (socket says 172.21.15.190:35614) 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 -- 172.21.15.190:0/1504070992 learned_addr learned my addr 172.21.15.190:0/1504070992 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a77fe640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1a80b56b0 0x7fe1a8070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:28.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 -- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1a813f6a0 msgr2=0x7fe1a81dddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1a813f6a0 0x7fe1a81dddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 -- 172.21.15.190:0/1504070992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1a80b56b0 msgr2=0x7fe1a8070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1a80b56b0 0x7fe1a8070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 -- 172.21.15.190:0/1504070992 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198009b30 con 0x7fe1a81497c0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a6ffd640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1a813f6a0 0x7fe1a81dddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1a7fff640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a81e1320 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1a001a040 tx=0x7fe1a00191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe18ffff640 1 -- 172.21.15.190:0/1504070992 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00a4ea0 con 0x7fe1a81497c0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe18ffff640 1 -- 172.21.15.190:0/1504070992 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a00b4400 con 0x7fe1a81497c0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a0009420 con 0x7fe1a81497c0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe18ffff640 1 -- 172.21.15.190:0/1504070992 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00b4790 con 0x7fe1a81497c0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a80b0690 con 0x7fe1a81497c0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe18ffff640 1 -- 172.21.15.190:0/1504070992 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe1a00b2040 con 0x7fe1a81497c0 2024-09-13T17:20:28.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe18ffff640 1 -- 172.21.15.190:0/1504070992 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe1a00aa3a0 con 0x7fe1a81497c0 2024-09-13T17:20:28.885 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.881+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a81460b0 con 0x7fe1a81497c0 2024-09-13T17:20:28.885 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.885+0000 7fe18ffff640 1 -- 172.21.15.190:0/1504070992 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe1a00bb020 con 0x7fe1a81497c0 2024-09-13T17:20:28.898 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.892+0000 7f2382f59180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:20:28.957 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:28.952+0000 7f2382f59180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:20:28.960 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.957+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74655c1c-585c-4d21-99d7-66ef2600bcaa", "id": 6} v 0) v1 -- 0x7fe1a80aef00 con 0x7fe1a81497c0 2024-09-13T17:20:28.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe18ffff640 1 -- 172.21.15.190:0/1504070992 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74655c1c-585c-4d21-99d7-66ef2600bcaa", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe1a00b0070 con 0x7fe1a81497c0 2024-09-13T17:20:28.970 INFO:teuthology.orchestra.run.smithi190.stdout:6 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 msgr2=0x7fe1a81e1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a81e1320 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1a001a040 tx=0x7fe1a00191b0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 shutdown_connections 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1a81497c0 0x7fe1a81e1320 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1a813f6a0 0x7fe1a81dddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 --2- 172.21.15.190:0/1504070992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1a80b56b0 0x7fe1a8070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 >> 172.21.15.190:0/1504070992 conn(0x7fe1a80b8840 msgr2=0x7fe1a8099ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 shutdown_connections 2024-09-13T17:20:28.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:28.969+0000 7fe1ade08640 1 -- 172.21.15.190:0/1504070992 wait complete. 2024-09-13T17:20:28.974 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:28.973+0000 7f7d282d8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:20:28.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 4b299b30-ef7c-45c5-ba77-14a1e74a9002 7 2024-09-13T17:20:29.036 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:29.033+0000 7f7d282d8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:20:29.143 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264c6aa640 1 Processor -- start 2024-09-13T17:20:29.143 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264c6aa640 1 -- start start 2024-09-13T17:20:29.144 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264c6aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26440b56b0 0x7f26440ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.144 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264c6aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f264409a690 0x7f264409ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264c6aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26441401d0 con 0x7f26440ad7a0 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264c6aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26440ae520 con 0x7f26440b56b0 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264c6aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26440b5a90 con 0x7f264409a690 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264ac47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f264409a690 0x7f264409ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264ac47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f264409a690 0x7f264409ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40186/0 (socket says 172.21.15.190:40186) 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264ac47640 1 -- 172.21.15.190:0/4284716691 learned_addr learned my addr 172.21.15.190:0/4284716691 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264a446640 1 --2- 172.21.15.190:0/4284716691 >> v2:172.21.15.167:3300/0 conn(0x7f26440b56b0 0x7f26440ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264ac47640 1 -- 172.21.15.190:0/4284716691 >> v2:172.21.15.167:3300/0 conn(0x7f26440b56b0 msgr2=0x7f26440ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264ac47640 1 --2- 172.21.15.190:0/4284716691 >> v2:172.21.15.167:3300/0 conn(0x7f26440b56b0 0x7f26440ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264ac47640 1 -- 172.21.15.190:0/4284716691 >> v1:172.21.15.167:6789/0 conn(0x7f26440ad7a0 legacy=0x7f2644145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.145 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.141+0000 7f264ac47640 1 -- 172.21.15.190:0/4284716691 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26440ae9b0 con 0x7f264409a690 2024-09-13T17:20:29.147 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264ac47640 1 --2- 172.21.15.190:0/4284716691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f264409a690 0x7f264409ab00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f264406f450 tx=0x7f264001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365cabc022ada08f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:29.148 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f2649444640 1 -- 172.21.15.190:0/4284716691 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400ab660 con 0x7f264409a690 2024-09-13T17:20:29.148 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f2649444640 1 -- 172.21.15.190:0/4284716691 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26400ab7c0 con 0x7f264409a690 2024-09-13T17:20:29.148 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f2649444640 1 -- 172.21.15.190:0/4284716691 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400abb50 con 0x7f264409a690 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 -- 172.21.15.190:0/4284716691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f264409a690 msgr2=0x7f264409ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 --2- 172.21.15.190:0/4284716691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f264409a690 0x7f264409ab00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f264406f450 tx=0x7f264001c460 comp rx=0 tx=0).stop 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 -- 172.21.15.190:0/4284716691 shutdown_connections 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 --2- 172.21.15.190:0/4284716691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f264409a690 0x7f264409ab00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 --2- 172.21.15.190:0/4284716691 >> v2:172.21.15.167:3300/0 conn(0x7f26440b56b0 0x7f26440ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 -- 172.21.15.190:0/4284716691 >> 172.21.15.190:0/4284716691 conn(0x7f26440b8840 msgr2=0x7f26440b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 -- 172.21.15.190:0/4284716691 shutdown_connections 2024-09-13T17:20:29.149 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.145+0000 7f264c6aa640 1 -- 172.21.15.190:0/4284716691 wait complete. 2024-09-13T17:20:29.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 Processor -- start 2024-09-13T17:20:29.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 -- start start 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f264409a690 0x7f2644139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26440ad7a0 0x7f26440b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26440b56b0 0x7f26441e1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264413a560 con 0x7f26440ad7a0 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264413ab90 con 0x7f26440b56b0 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26441386c0 con 0x7f264409a690 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f264409a690 0x7f2644139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264ac47640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26440b56b0 0x7f26441e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f264409a690 0x7f2644139870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:35630/0 (socket says 172.21.15.190:35630) 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 -- 172.21.15.190:0/3330050622 learned_addr learned my addr 172.21.15.190:0/3330050622 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f2649c45640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26440ad7a0 0x7f26440b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 -- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26440b56b0 msgr2=0x7f26441e1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26440b56b0 0x7f26441e1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 -- 172.21.15.190:0/3330050622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26440ad7a0 msgr2=0x7f26440b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26440ad7a0 0x7f26440b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 -- 172.21.15.190:0/3330050622 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400094d0 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264ac47640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26440b56b0 0x7f26441e1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264a446640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f264409a690 0x7f2644139870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f263c007e70 tx=0x7f263c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f263affd640 1 -- 172.21.15.190:0/3330050622 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c014620 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f263affd640 1 -- 172.21.15.190:0/3330050622 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c014780 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26440b6e10 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f263affd640 1 -- 172.21.15.190:0/3330050622 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c014b30 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2644138bf0 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f263affd640 1 -- 172.21.15.190:0/3330050622 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f263c01e460 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f263affd640 1 -- 172.21.15.190:0/3330050622 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f263c01ed70 con 0x7f264409a690 2024-09-13T17:20:29.154 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.149+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264409ab00 con 0x7f264409a690 2024-09-13T17:20:29.155 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.153+0000 7f263affd640 1 -- 172.21.15.190:0/3330050622 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f263c01e770 con 0x7f264409a690 2024-09-13T17:20:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.217+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4b299b30-ef7c-45c5-ba77-14a1e74a9002", "id": 7} v 0) v1 -- 0x7f2644142960 con 0x7f264409a690 2024-09-13T17:20:29.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f263affd640 1 -- 172.21.15.190:0/3330050622 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b299b30-ef7c-45c5-ba77-14a1e74a9002", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f263c02d0b0 con 0x7f264409a690 2024-09-13T17:20:29.226 INFO:teuthology.orchestra.run.smithi190.stdout:7 2024-09-13T17:20:29.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f264409a690 msgr2=0x7f2644139870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f264409a690 0x7f2644139870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f263c007e70 tx=0x7f263c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 shutdown_connections 2024-09-13T17:20:29.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26440b56b0 0x7f26441e1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26440ad7a0 0x7f26440b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 --2- 172.21.15.190:0/3330050622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f264409a690 0x7f2644139870 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 >> 172.21.15.190:0/3330050622 conn(0x7f26440b8840 msgr2=0x7f2644143140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:29.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 shutdown_connections 2024-09-13T17:20:29.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-13T17:20:29.225+0000 7f264c6aa640 1 -- 172.21.15.190:0/3330050622 wait complete. 2024-09-13T17:20:29.241 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T17:20:29.241 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T17:20:29.244 INFO:tasks.ceph.osd.0:Started 2024-09-13T17:20:29.244 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T17:20:29.244 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T17:20:29.247 INFO:tasks.ceph.osd.1:Started 2024-09-13T17:20:29.247 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T17:20:29.247 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T17:20:29.249 INFO:tasks.ceph.osd.2:Started 2024-09-13T17:20:29.249 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T17:20:29.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T17:20:29.252 INFO:tasks.ceph.osd.3:Started 2024-09-13T17:20:29.252 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T17:20:29.252 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T17:20:29.286 INFO:tasks.ceph.osd.4:Started 2024-09-13T17:20:29.286 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T17:20:29.286 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T17:20:29.289 INFO:tasks.ceph.osd.5:Started 2024-09-13T17:20:29.289 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T17:20:29.289 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T17:20:29.292 INFO:tasks.ceph.osd.6:Started 2024-09-13T17:20:29.292 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T17:20:29.292 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T17:20:29.294 INFO:tasks.ceph.osd.7:Started 2024-09-13T17:20:29.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:29.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb62c9e640 1 Processor -- start 2024-09-13T17:20:29.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb62c9e640 1 -- start start 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb62c9e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbb5c065ee0 0x7fbb5c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb62c9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb5c071170 0x7fbb5c14e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb62c9e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c06f3d0 con 0x7fbb5c070d20 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb62c9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c070870 con 0x7fbb5c071170 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb62c9e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c06ee50 con 0x7fbb5c065ee0 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb6123b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb5c071170 0x7fbb5c14e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb6123b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb5c071170 0x7fbb5c14e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43152/0 (socket says 172.21.15.167:43152) 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb6123b640 1 -- 172.21.15.167:0/879522036 learned_addr learned my addr 172.21.15.167:0/879522036 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb60a3a640 1 --2- 172.21.15.167:0/879522036 >> v2:172.21.15.190:3300/0 conn(0x7fbb5c065ee0 0x7fbb5c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb6123b640 1 -- 172.21.15.167:0/879522036 >> v2:172.21.15.190:3300/0 conn(0x7fbb5c065ee0 msgr2=0x7fbb5c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb6123b640 1 --2- 172.21.15.167:0/879522036 >> v2:172.21.15.190:3300/0 conn(0x7fbb5c065ee0 0x7fbb5c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb6123b640 1 -- 172.21.15.167:0/879522036 >> v1:172.21.15.190:6789/0 conn(0x7fbb5c070d20 legacy=0x7fbb5c13d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:29.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb6123b640 1 -- 172.21.15.167:0/879522036 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0662c0 con 0x7fbb5c071170 2024-09-13T17:20:29.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.436+0000 7fbb60a3a640 1 --2- 172.21.15.167:0/879522036 >> v2:172.21.15.190:3300/0 conn(0x7fbb5c065ee0 0x7fbb5c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:29.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb6123b640 1 --2- 172.21.15.167:0/879522036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c071170 0x7fbb5c14e0a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0664e0 tx=0x7fbb5401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82aa7212fdd9059 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:29.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb5b7fe640 1 -- 172.21.15.167:0/879522036 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540a5730 con 0x7fbb5c071170 2024-09-13T17:20:29.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb5b7fe640 1 -- 172.21.15.167:0/879522036 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540a5890 con 0x7fbb5c071170 2024-09-13T17:20:29.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb5b7fe640 1 -- 172.21.15.167:0/879522036 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540a5c20 con 0x7fbb5c071170 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- 172.21.15.167:0/879522036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c071170 msgr2=0x7fbb5c14e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 --2- 172.21.15.167:0/879522036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c071170 0x7fbb5c14e0a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0664e0 tx=0x7fbb5401c960 comp rx=0 tx=0).stop 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- 172.21.15.167:0/879522036 shutdown_connections 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 --2- 172.21.15.167:0/879522036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c071170 0x7fbb5c14e0a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 --2- 172.21.15.167:0/879522036 >> v2:172.21.15.190:3300/0 conn(0x7fbb5c065ee0 0x7fbb5c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- 172.21.15.167:0/879522036 >> 172.21.15.167:0/879522036 conn(0x7fbb5c0b4560 msgr2=0x7fbb5c0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- 172.21.15.167:0/879522036 shutdown_connections 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- 172.21.15.167:0/879522036 wait complete. 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 Processor -- start 2024-09-13T17:20:29.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- start start 2024-09-13T17:20:29.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c065ee0 0x7fbb5c1dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb5c070d20 0x7fbb5c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb5c071170 0x7fbb5c13f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c1df5f0 con 0x7fbb5c065ee0 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0991e0 con 0x7fbb5c070d20 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0996f0 con 0x7fbb5c071170 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c065ee0 0x7fbb5c1dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c065ee0 0x7fbb5c1dfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43168/0 (socket says 172.21.15.167:43168) 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 -- 172.21.15.167:0/1741474173 learned_addr learned my addr 172.21.15.167:0/1741474173 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb5bfff640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb5c070d20 0x7fbb5c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb6123b640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb5c071170 0x7fbb5c13f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 -- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb5c071170 msgr2=0x7fbb5c13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb5c071170 0x7fbb5c13f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 -- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb5c070d20 msgr2=0x7fbb5c0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb5c070d20 0x7fbb5c0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 -- 172.21.15.167:0/1741474173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54009b30 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb60a3a640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c065ee0 0x7fbb5c1dfa10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00c7c0 tx=0x7fbb4c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb597fa640 1 -- 172.21.15.167:0/1741474173 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c007a30 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb597fa640 1 -- 172.21.15.167:0/1741474173 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c007b90 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c1def30 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb597fa640 1 -- 172.21.15.167:0/1741474173 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00ce70 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c099410 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb597fa640 1 -- 172.21.15.167:0/1741474173 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbb4c0193f0 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.440+0000 7fbb597fa640 1 -- 172.21.15.167:0/1741474173 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbb4c011b60 con 0x7fbb5c065ee0 2024-09-13T17:20:29.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.444+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c06d690 con 0x7fbb5c065ee0 2024-09-13T17:20:29.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.452+0000 7fbb597fa640 1 -- 172.21.15.167:0/1741474173 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fbb4c01e060 con 0x7fbb5c065ee0 2024-09-13T17:20:29.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.516+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb5c06fe20 con 0x7fbb5c065ee0 2024-09-13T17:20:29.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.516+0000 7fbb597fa640 1 -- 172.21.15.167:0/1741474173 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbb4c011d70 con 0x7fbb5c065ee0 2024-09-13T17:20:29.521 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:29.521 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":10,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:29.221316+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:29.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c065ee0 msgr2=0x7fbb5c1dfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c065ee0 0x7fbb5c1dfa10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00c7c0 tx=0x7fbb4c00cc80 comp rx=0 tx=0).stop 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 shutdown_connections 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb5c071170 0x7fbb5c13f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb5c070d20 0x7fbb5c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 --2- 172.21.15.167:0/1741474173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5c065ee0 0x7fbb5c1dfa10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 >> 172.21.15.167:0/1741474173 conn(0x7fbb5c0b4560 msgr2=0x7fbb5c13c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 shutdown_connections 2024-09-13T17:20:29.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:29.520+0000 7fbb62c9e640 1 -- 172.21.15.167:0/1741474173 wait complete. 2024-09-13T17:20:29.539 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T17:20:29.539 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T17:20:29.593 INFO:tasks.ceph.mgr.y.smithi167.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T17:20:29.593 INFO:tasks.ceph.mgr.y.smithi167.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T17:20:29.593 INFO:tasks.ceph.mgr.y.smithi167.stderr: from numpy import show_config as show_numpy_config 2024-09-13T17:20:29.639 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:29.636+0000 7f2382f59180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:20:29.662 INFO:tasks.ceph.mgr.x.smithi190.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T17:20:29.662 INFO:tasks.ceph.mgr.x.smithi190.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T17:20:29.662 INFO:tasks.ceph.mgr.x.smithi190.stderr: from numpy import show_config as show_numpy_config 2024-09-13T17:20:29.678 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-13T17:20:29.677+0000 7f2c919d67c0 -1 Falling back to public interface 2024-09-13T17:20:29.681 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-13T17:20:29.681+0000 7fa01aa867c0 -1 Falling back to public interface 2024-09-13T17:20:29.682 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-13T17:20:29.681+0000 7ffa5d7c77c0 -1 Falling back to public interface 2024-09-13T17:20:29.709 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:29.709+0000 7f7d282d8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:20:29.770 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:29.768+0000 7f2382f59180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:20:29.857 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:29.857+0000 7f7d282d8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:20:29.903 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-13T17:20:29.900+0000 7ffa865dd7c0 -1 Falling back to public interface 2024-09-13T17:20:29.903 INFO:tasks.ceph.osd.0.smithi167.stderr:2024-09-13T17:20:29.900+0000 7f08511dd7c0 -1 Falling back to public interface 2024-09-13T17:20:29.918 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-13T17:20:29.917+0000 7f358047d7c0 -1 Falling back to public interface 2024-09-13T17:20:29.927 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-13T17:20:29.924+0000 7f2a18c247c0 -1 Falling back to public interface 2024-09-13T17:20:29.927 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-13T17:20:29.924+0000 7f5cdf4d57c0 -1 Falling back to public interface 2024-09-13T17:20:29.932 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:29.928+0000 7f2382f59180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:20:29.995 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:29.992+0000 7f2382f59180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:20:30.013 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:30.013+0000 7f7d282d8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:20:30.076 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:30.073+0000 7f7d282d8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:20:30.129 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:30.124+0000 7f2382f59180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:20:30.210 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:30.209+0000 7f7d282d8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:20:30.344 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:30.457 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.452+0000 7fee877f3640 1 Processor -- start 2024-09-13T17:20:30.457 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.452+0000 7fee877f3640 1 -- start start 2024-09-13T17:20:30.459 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee877f3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee8013ca60 0x7fee80145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:30.459 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee877f3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee801461d0 0x7fee8014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:30.459 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee877f3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee80146660 con 0x7fee800b5540 2024-09-13T17:20:30.459 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee877f3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800b5920 con 0x7fee801461d0 2024-09-13T17:20:30.459 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee877f3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee80072070 con 0x7fee8013ca60 2024-09-13T17:20:30.459 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee85d90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee801461d0 0x7fee8014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:30.459 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee85d90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee801461d0 0x7fee8014cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43178/0 (socket says 172.21.15.167:43178) 2024-09-13T17:20:30.460 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee85d90640 1 -- 172.21.15.167:0/367742808 learned_addr learned my addr 172.21.15.167:0/367742808 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:30.460 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee84d8e640 1 --2- 172.21.15.167:0/367742808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee8013ca60 0x7fee80145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:30.460 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee85d90640 1 -- 172.21.15.167:0/367742808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee8013ca60 msgr2=0x7fee80145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:30.460 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee85d90640 1 --2- 172.21.15.167:0/367742808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee8013ca60 0x7fee80145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.460 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee85d90640 1 -- 172.21.15.167:0/367742808 >> v1:172.21.15.190:6789/0 conn(0x7fee800b5540 legacy=0x7fee8013c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:30.460 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.456+0000 7fee85d90640 1 -- 172.21.15.167:0/367742808 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80070a60 con 0x7fee801461d0 2024-09-13T17:20:30.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee85d90640 1 --2- 172.21.15.167:0/367742808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee801461d0 0x7fee8014cf20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee78009e50 tx=0x7fee7801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983118019d7c1c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:30.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee77fff640 1 -- 172.21.15.167:0/367742808 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780a5830 con 0x7fee801461d0 2024-09-13T17:20:30.463 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee77fff640 1 -- 172.21.15.167:0/367742808 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee780a5990 con 0x7fee801461d0 2024-09-13T17:20:30.463 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee77fff640 1 -- 172.21.15.167:0/367742808 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780a5d20 con 0x7fee801461d0 2024-09-13T17:20:30.463 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- 172.21.15.167:0/367742808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee801461d0 msgr2=0x7fee8014cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:30.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 --2- 172.21.15.167:0/367742808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee801461d0 0x7fee8014cf20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee78009e50 tx=0x7fee7801c970 comp rx=0 tx=0).stop 2024-09-13T17:20:30.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- 172.21.15.167:0/367742808 shutdown_connections 2024-09-13T17:20:30.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 --2- 172.21.15.167:0/367742808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee801461d0 0x7fee8014cf20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 --2- 172.21.15.167:0/367742808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee8013ca60 0x7fee80145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- 172.21.15.167:0/367742808 >> 172.21.15.167:0/367742808 conn(0x7fee8006b450 msgr2=0x7fee8006b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:30.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- 172.21.15.167:0/367742808 shutdown_connections 2024-09-13T17:20:30.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- 172.21.15.167:0/367742808 wait complete. 2024-09-13T17:20:30.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 Processor -- start 2024-09-13T17:20:30.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- start start 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee800b5540 0x7fee8013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee8013ca60 0x7fee80138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee801461d0 0x7fee80137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8013a5e0 con 0x7fee8013ca60 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8013e580 con 0x7fee801461d0 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee877f3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8013e790 con 0x7fee800b5540 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee84d8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee8013ca60 0x7fee80138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee84d8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee8013ca60 0x7fee80138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43182/0 (socket says 172.21.15.167:43182) 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee84d8e640 1 -- 172.21.15.167:0/3461931973 learned_addr learned my addr 172.21.15.167:0/3461931973 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:30.467 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee85d90640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee801461d0 0x7fee80137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.460+0000 7fee8558f640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee800b5540 0x7fee8013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee84d8e640 1 -- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee800b5540 msgr2=0x7fee8013f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee84d8e640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee800b5540 0x7fee8013f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee84d8e640 1 -- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee801461d0 msgr2=0x7fee80137570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee84d8e640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee801461d0 0x7fee80137570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee84d8e640 1 -- 172.21.15.167:0/3461931973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009b30 con 0x7fee8013ca60 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee85d90640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee801461d0 0x7fee80137570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee84d8e640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee8013ca60 0x7fee80138ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fee7000d800 tx=0x7fee7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee75ffb640 1 -- 172.21.15.167:0/3461931973 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70018070 con 0x7fee8013ca60 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee75ffb640 1 -- 172.21.15.167:0/3461931973 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee70004020 con 0x7fee8013ca60 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee75ffb640 1 -- 172.21.15.167:0/3461931973 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700041d0 con 0x7fee8013ca60 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee80139f80 con 0x7fee8013ca60 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8013a200 con 0x7fee8013ca60 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee75ffb640 1 -- 172.21.15.167:0/3461931973 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fee7000b6c0 con 0x7fee8013ca60 2024-09-13T17:20:30.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee75ffb640 1 -- 172.21.15.167:0/3461931973 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fee70014b00 con 0x7fee8013ca60 2024-09-13T17:20:30.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee80145c90 con 0x7fee8013ca60 2024-09-13T17:20:30.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.464+0000 7fee75ffb640 1 -- 172.21.15.167:0/3461931973 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fee70014d60 con 0x7fee8013ca60 2024-09-13T17:20:30.526 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee8013ffc0 con 0x7fee8013ca60 2024-09-13T17:20:30.527 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee75ffb640 1 -- 172.21.15.167:0/3461931973 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fee7000bb00 con 0x7fee8013ca60 2024-09-13T17:20:30.527 INFO:teuthology.misc.health.smithi167.stdout: 2024-09-13T17:20:30.527 INFO:teuthology.misc.health.smithi167.stdout:{"epoch":10,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:29.221316+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee8013ca60 msgr2=0x7fee80138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee8013ca60 0x7fee80138ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fee7000d800 tx=0x7fee7000dcc0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 shutdown_connections 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee801461d0 0x7fee80137570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee8013ca60 0x7fee80138ae0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 --2- 172.21.15.167:0/3461931973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee800b5540 0x7fee8013f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 >> 172.21.15.167:0/3461931973 conn(0x7fee8006b450 msgr2=0x7fee800b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 shutdown_connections 2024-09-13T17:20:30.529 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:30.524+0000 7fee877f3640 1 -- 172.21.15.167:0/3461931973 wait complete. 2024-09-13T17:20:30.542 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:20:30.778 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:30.776+0000 7f2382f59180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:20:30.831 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:30.829+0000 7f7d282d8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:20:30.853 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:30.848+0000 7f2382f59180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:20:30.909 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:30.909+0000 7f7d282d8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:20:31.033 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:31.028+0000 7f2382f59180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:20:31.089 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:31.089+0000 7f7d282d8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:20:31.105 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:31.100+0000 7f2382f59180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:20:31.162 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:31.161+0000 7f7d282d8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:20:31.394 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:31.392+0000 7f2382f59180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:20:31.455 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:31.453+0000 7f7d282d8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:20:31.459 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:31.456+0000 7f2382f59180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:20:31.521 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-09-13T17:20:31.521+0000 7f7d282d8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:20:32.499 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:32.496+0000 7f232a50a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T17:20:32.499 INFO:tasks.ceph.mgr.y.smithi167.stderr:2024-09-13T17:20:32.496+0000 7f232a50a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T17:20:33.367 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-13T17:20:33.364+0000 7f2a18c247c0 -1 osd.2 0 log_to_monitors true 2024-09-13T17:20:33.489 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-13T17:20:33.489+0000 7f2c919d67c0 -1 osd.7 0 log_to_monitors true 2024-09-13T17:20:33.539 INFO:tasks.ceph.osd.0.smithi167.stderr:2024-09-13T17:20:33.536+0000 7f08511dd7c0 -1 osd.0 0 log_to_monitors true 2024-09-13T17:20:33.569 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-13T17:20:33.569+0000 7fa01aa867c0 -1 osd.6 0 log_to_monitors true 2024-09-13T17:20:33.605 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-13T17:20:33.605+0000 7ffa5d7c77c0 -1 osd.4 0 log_to_monitors true 2024-09-13T17:20:33.712 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-13T17:20:33.713+0000 7f358047d7c0 -1 osd.5 0 log_to_monitors true 2024-09-13T17:20:33.751 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-13T17:20:33.748+0000 7f5cdf4d57c0 -1 osd.3 0 log_to_monitors true 2024-09-13T17:20:33.850 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-13T17:20:33.848+0000 7ffa865dd7c0 -1 osd.1 0 log_to_monitors true 2024-09-13T17:20:35.396 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-13T17:20:35.392+0000 7f2a14bc9640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:20:35.423 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-13T17:20:35.420+0000 7f2a0c9fc640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:37.261 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-13T17:20:37.260+0000 7f5cdb47a640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:20:37.287 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-13T17:20:37.288+0000 7f5cd32ad640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:37.315 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-13T17:20:37.316+0000 7ffa82582640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:20:37.334 INFO:tasks.ceph.osd.0.smithi167.stderr:2024-09-13T17:20:37.336+0000 7f084d182640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T17:20:37.348 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:37.355 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-13T17:20:37.356+0000 7ffa7a3b5640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:37.362 INFO:tasks.ceph.osd.0.smithi167.stderr:2024-09-13T17:20:37.364+0000 7f0844fb5640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:37.460 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66eb3ef640 1 Processor -- start 2024-09-13T17:20:37.461 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66eb3ef640 1 -- start start 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66eb3ef640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66e406d820 0x7f66e4143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66eb3ef640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40b4470 con 0x7f66e4071970 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66eb3ef640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e406dc00 con 0x7f66e40b4010 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66eb3ef640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40b4710 con 0x7f66e406d820 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66e918b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66e406d820 0x7f66e4143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66e998c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f66e4071970 0x7f66e414e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51606/0 (socket says 172.21.15.167:51606) 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66e998c640 1 -- 172.21.15.167:0/1017462962 learned_addr learned my addr 172.21.15.167:0/1017462962 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66e918b640 1 -- 172.21.15.167:0/1017462962 >> v1:172.21.15.190:6789/0 conn(0x7f66e40b4010 legacy=0x7f66e4143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66e918b640 1 -- 172.21.15.167:0/1017462962 >> v1:172.21.15.167:6789/0 conn(0x7f66e4071970 legacy=0x7f66e414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66e918b640 1 -- 172.21.15.167:0/1017462962 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40b49f0 con 0x7f66e406d820 2024-09-13T17:20:37.462 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.460+0000 7f66dbfff640 1 -- 172.21.15.167:0/1017462962 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457480761 0 0) 0x7f66e40b4470 con 0x7f66e4071970 2024-09-13T17:20:37.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66e918b640 1 --2- 172.21.15.167:0/1017462962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e406d820 0x7f66e4143150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66e00097c0 tx=0x7f66e001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac80d015c7e53b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:37.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66dbfff640 1 -- 172.21.15.167:0/1017462962 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00ab600 con 0x7f66e406d820 2024-09-13T17:20:37.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66dbfff640 1 -- 172.21.15.167:0/1017462962 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e00a7050 con 0x7f66e406d820 2024-09-13T17:20:37.464 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66dbfff640 1 -- 172.21.15.167:0/1017462962 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00ab980 con 0x7f66e406d820 2024-09-13T17:20:37.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1017462962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e406d820 msgr2=0x7f66e4143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:37.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1017462962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e406d820 0x7f66e4143150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66e00097c0 tx=0x7f66e001c410 comp rx=0 tx=0).stop 2024-09-13T17:20:37.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1017462962 shutdown_connections 2024-09-13T17:20:37.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1017462962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e406d820 0x7f66e4143150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:37.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1017462962 >> 172.21.15.167:0/1017462962 conn(0x7f66e40b9250 msgr2=0x7f66e40b9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:37.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1017462962 shutdown_connections 2024-09-13T17:20:37.465 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1017462962 wait complete. 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 Processor -- start 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.464+0000 7f66eb3ef640 1 -- start start 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e406d820 0x7f66e4146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e4071970 0x7f66e40adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e40b4010 0x7f66e41e21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e41e1d90 con 0x7f66e4071970 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40ad660 con 0x7f66e40b4010 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4099b20 con 0x7f66e406d820 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e4071970 0x7f66e40adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e4071970 0x7f66e40adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58418/0 (socket says 172.21.15.167:58418) 2024-09-13T17:20:37.468 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 -- 172.21.15.167:0/1935260023 learned_addr learned my addr 172.21.15.167:0/1935260023 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e998c640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e40b4010 0x7f66e41e21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e918b640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e406d820 0x7f66e4146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 -- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e406d820 msgr2=0x7f66e4146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e406d820 0x7f66e4146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 -- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e40b4010 msgr2=0x7f66e41e21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e40b4010 0x7f66e41e21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 -- 172.21.15.167:0/1935260023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0009420 con 0x7f66e4071970 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e918b640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e406d820 0x7f66e4146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:37.469 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e898a640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e4071970 0x7f66e40adde0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66d400c3c0 tx=0x7f66d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:37.470 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66d9ffb640 1 -- 172.21.15.167:0/1935260023 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40052d0 con 0x7f66e4071970 2024-09-13T17:20:37.470 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66d9ffb640 1 -- 172.21.15.167:0/1935260023 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4005430 con 0x7f66e4071970 2024-09-13T17:20:37.470 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e40ae880 con 0x7f66e4071970 2024-09-13T17:20:37.470 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66d9ffb640 1 -- 172.21.15.167:0/1935260023 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003840 con 0x7f66e4071970 2024-09-13T17:20:37.470 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e40ae4f0 con 0x7f66e4071970 2024-09-13T17:20:37.471 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e41e1f00 con 0x7f66e4071970 2024-09-13T17:20:37.471 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66d9ffb640 1 -- 172.21.15.167:0/1935260023 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f66d40039a0 con 0x7f66e4071970 2024-09-13T17:20:37.471 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66d9ffb640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f66c8066600 0x7f66c8068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:37.471 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66d9ffb640 1 -- 172.21.15.167:0/1935260023 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f66d40827f0 con 0x7f66e4071970 2024-09-13T17:20:37.471 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e918b640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f66c8066600 0x7f66c8068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:37.472 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.468+0000 7f66e918b640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f66c8066600 0x7f66c8068ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66e00ad000 tx=0x7f66e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:37.473 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.472+0000 7f66d9ffb640 1 -- 172.21.15.167:0/1935260023 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66e41e1f00 con 0x7f66e4071970 2024-09-13T17:20:37.634 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.632+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66e40ad7d0 con 0x7f66e4071970 2024-09-13T17:20:37.634 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66d9ffb640 1 -- 172.21.15.167:0/1935260023 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7589 (secure 0 0 0) 0x7f66e40ad7d0 con 0x7f66e4071970 2024-09-13T17:20:37.635 INFO:teuthology.misc.health.smithi167.stdout: 2024-09-13T17:20:37.635 INFO:teuthology.misc.health.smithi167.stdout:{"epoch":14,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:36.564818+0000","last_up_change":"2024-09-13T17:20:35.505067+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f66c8066600 msgr2=0x7f66c8068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f66c8066600 0x7f66c8068ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66e00ad000 tx=0x7f66e0008040 comp rx=0 tx=0).stop 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e4071970 msgr2=0x7f66e40adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e4071970 0x7f66e40adde0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66d400c3c0 tx=0x7f66d400c880 comp rx=0 tx=0).stop 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 shutdown_connections 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f66c8066600 0x7f66c8068ac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e40b4010 0x7f66e41e21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e4071970 0x7f66e40adde0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 --2- 172.21.15.167:0/1935260023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e406d820 0x7f66e4146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 >> 172.21.15.167:0/1935260023 conn(0x7f66e40b9250 msgr2=0x7f66e4070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:37.638 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 shutdown_connections 2024-09-13T17:20:37.639 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:37.636+0000 7f66eb3ef640 1 -- 172.21.15.167:0/1935260023 wait complete. 2024-09-13T17:20:37.652 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-13T17:20:37.729 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-13T17:20:37.725+0000 7ffa5976c640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:20:37.732 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-13T17:20:37.729+0000 7f357c422640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:20:37.757 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-13T17:20:37.757+0000 7f3574255640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:37.758 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-13T17:20:37.757+0000 7ffa5159f640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:37.759 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-13T17:20:37.757+0000 7fa016a2b640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T17:20:37.789 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-13T17:20:37.789+0000 7f2c8d97b640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T17:20:37.797 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-13T17:20:37.797+0000 7fa00e85e640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:37.817 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-13T17:20:37.817+0000 7f2c857ae640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:20:44.459 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:44.582 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.579+0000 7f445cfdb640 1 Processor -- start 2024-09-13T17:20:44.583 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f445cfdb640 1 -- start start 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f445cfdb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44580b8ac0 0x7f4458070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f445cfdb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f445813c830 0x7f445814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f445cfdb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44580af6f0 con 0x7f4458145b40 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f445cfdb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44580b26d0 con 0x7f445813c830 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f445cfdb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44580b8ea0 con 0x7f44580b8ac0 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4456d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f445813c830 0x7f445814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f444ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4458145b40 0x7f445813c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51618/0 (socket says 172.21.15.167:51618) 2024-09-13T17:20:44.584 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f444ffff640 1 -- 172.21.15.167:0/3981518986 learned_addr learned my addr 172.21.15.167:0/3981518986 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:44.585 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f445659c640 1 --2- 172.21.15.167:0/3981518986 >> v2:172.21.15.190:3300/0 conn(0x7f44580b8ac0 0x7f4458070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.585 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4456d9d640 1 -- 172.21.15.167:0/3981518986 >> v2:172.21.15.190:3300/0 conn(0x7f44580b8ac0 msgr2=0x7f4458070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:44.585 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4456d9d640 1 --2- 172.21.15.167:0/3981518986 >> v2:172.21.15.190:3300/0 conn(0x7f44580b8ac0 0x7f4458070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.585 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4456d9d640 1 -- 172.21.15.167:0/3981518986 >> v1:172.21.15.167:6789/0 conn(0x7f4458145b40 legacy=0x7f445813c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.585 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4456d9d640 1 -- 172.21.15.167:0/3981518986 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458070500 con 0x7f445813c830 2024-09-13T17:20:44.585 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4455d9b640 1 -- 172.21.15.167:0/3981518986 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035453283 0 0) 0x7f44580af6f0 con 0x7f4458145b40 2024-09-13T17:20:44.586 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4456d9d640 1 --2- 172.21.15.167:0/3981518986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814ced0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44580b2810 tx=0x7f445001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee2d9b0e2fbe4de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:44.586 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.583+0000 7f4455d9b640 1 -- 172.21.15.167:0/3981518986 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500a5740 con 0x7f445813c830 2024-09-13T17:20:44.586 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f4455d9b640 1 -- 172.21.15.167:0/3981518986 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500a58a0 con 0x7f445813c830 2024-09-13T17:20:44.586 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f4455d9b640 1 -- 172.21.15.167:0/3981518986 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500a5c30 con 0x7f445813c830 2024-09-13T17:20:44.587 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- 172.21.15.167:0/3981518986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 msgr2=0x7f445814ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.587 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 --2- 172.21.15.167:0/3981518986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814ced0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44580b2810 tx=0x7f445001c8a0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.587 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- 172.21.15.167:0/3981518986 shutdown_connections 2024-09-13T17:20:44.587 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 --2- 172.21.15.167:0/3981518986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814ced0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.587 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 --2- 172.21.15.167:0/3981518986 >> v2:172.21.15.190:3300/0 conn(0x7f44580b8ac0 0x7f4458070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.588 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- 172.21.15.167:0/3981518986 >> 172.21.15.167:0/3981518986 conn(0x7f445806b650 msgr2=0x7f44580b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:44.588 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- 172.21.15.167:0/3981518986 shutdown_connections 2024-09-13T17:20:44.588 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- 172.21.15.167:0/3981518986 wait complete. 2024-09-13T17:20:44.588 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 Processor -- start 2024-09-13T17:20:44.588 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- start start 2024-09-13T17:20:44.590 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44580b8ac0 0x7f4458137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.590 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.590 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4458145b40 0x7f445814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445814c870 con 0x7f445813c830 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44581408d0 con 0x7f4458145b40 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4458150280 con 0x7f44580b8ac0 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58470/0 (socket says 172.21.15.167:58470) 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 -- 172.21.15.167:0/4097596717 learned_addr learned my addr 172.21.15.167:0/4097596717 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f4456d9d640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4458145b40 0x7f445814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445659c640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44580b8ac0 0x7f4458137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 -- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44580b8ac0 msgr2=0x7f4458137330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44580b8ac0 0x7f4458137330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 -- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4458145b40 msgr2=0x7f445814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4458145b40 0x7f445814ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.591 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 -- 172.21.15.167:0/4097596717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450009a70 con 0x7f445813c830 2024-09-13T17:20:44.592 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445659c640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44580b8ac0 0x7f4458137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:44.592 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444ffff640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814e9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f444000c4b0 tx=0x7f444000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:44.592 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444effd640 1 -- 172.21.15.167:0/4097596717 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44400074e0 con 0x7f445813c830 2024-09-13T17:20:44.592 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444effd640 1 -- 172.21.15.167:0/4097596717 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440007660 con 0x7f445813c830 2024-09-13T17:20:44.592 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44581405f0 con 0x7f445813c830 2024-09-13T17:20:44.592 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f444effd640 1 -- 172.21.15.167:0/4097596717 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440004a30 con 0x7f445813c830 2024-09-13T17:20:44.592 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.587+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445814e4c0 con 0x7f445813c830 2024-09-13T17:20:44.593 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.591+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445814e6e0 con 0x7f445813c830 2024-09-13T17:20:44.593 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.591+0000 7f444effd640 1 -- 172.21.15.167:0/4097596717 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4440004b90 con 0x7f445813c830 2024-09-13T17:20:44.593 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.591+0000 7f444effd640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4438066690 0x7f4438068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.593 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.591+0000 7f444effd640 1 -- 172.21.15.167:0/4097596717 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4440082eb0 con 0x7f445813c830 2024-09-13T17:20:44.593 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.591+0000 7f445659c640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4438066690 0x7f4438068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.593 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.591+0000 7f445659c640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4438066690 0x7f4438068b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4448009840 tx=0x7f4448008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:44.596 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.595+0000 7f444effd640 1 -- 172.21.15.167:0/4097596717 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4440054090 con 0x7f445813c830 2024-09-13T17:20:44.755 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.755+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f445814e130 con 0x7f445813c830 2024-09-13T17:20:44.757 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.755+0000 7f444effd640 1 -- 172.21.15.167:0/4097596717 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f4440018020 con 0x7f445813c830 2024-09-13T17:20:44.757 INFO:teuthology.misc.health.smithi167.stdout: 2024-09-13T17:20:44.758 INFO:teuthology.misc.health.smithi167.stdout:{"epoch":19,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:42.367647+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:44.759 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4438066690 msgr2=0x7f4438068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.759 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4438066690 0x7f4438068b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4448009840 tx=0x7f4448008040 comp rx=0 tx=0).stop 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 msgr2=0x7f445814e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814e9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f444000c4b0 tx=0x7f444000c970 comp rx=0 tx=0).stop 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 shutdown_connections 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4438066690 0x7f4438068b50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4458145b40 0x7f445814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445813c830 0x7f445814e9e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 --2- 172.21.15.167:0/4097596717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44580b8ac0 0x7f4458137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 >> 172.21.15.167:0/4097596717 conn(0x7f445806b650 msgr2=0x7f44581442d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 shutdown_connections 2024-09-13T17:20:44.760 INFO:teuthology.misc.health.smithi167.stderr:2024-09-13T17:20:44.759+0000 7f445cfdb640 1 -- 172.21.15.167:0/4097596717 wait complete. 2024-09-13T17:20:44.775 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T17:20:44.775 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T17:20:44.775 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:20:44.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:20:44.777 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:20:44.778 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:20:44.778 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:20:44.780 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:20:44.780 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T17:20:44.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:44.870 INFO:tasks.ceph.mds.a.smithi167.stdout:starting mds.a at 2024-09-13T17:20:44.875 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-09-13T17:20:44.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9aa1268640 1 Processor -- start 2024-09-13T17:20:44.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9aa1268640 1 -- start start 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9aa1268640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a9c1431c0 0x7f9a9c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9aa1268640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9c0b4940 con 0x7f9a9c06d7f0 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9aa1268640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9c0b4380 con 0x7f9a9c1465c0 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9aa1268640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9c145a60 con 0x7f9a9c1431c0 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9a9b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a9c1431c0 0x7f9a9c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9a9affd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9a9c06d7f0 0x7f9a9c145eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51634/0 (socket says 172.21.15.167:51634) 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.891+0000 7f9a9affd640 1 -- 172.21.15.167:0/3130723599 learned_addr learned my addr 172.21.15.167:0/3130723599 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a9b7fe640 1 -- 172.21.15.167:0/3130723599 >> v1:172.21.15.190:6789/0 conn(0x7f9a9c1465c0 legacy=0x7f9a9c142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a9b7fe640 1 -- 172.21.15.167:0/3130723599 >> v1:172.21.15.167:6789/0 conn(0x7f9a9c06d7f0 legacy=0x7f9a9c145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a9b7fe640 1 -- 172.21.15.167:0/3130723599 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0b4660 con 0x7f9a9c1431c0 2024-09-13T17:20:44.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a99ffb640 1 -- 172.21.15.167:0/3130723599 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421980388 0 0) 0x7f9a8c001120 con 0x7f9a9c06d7f0 2024-09-13T17:20:44.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a9b7fe640 1 --2- 172.21.15.167:0/3130723599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c0b3da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009d90 tx=0x7f9a9401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc4acae7539a24a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:44.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a99ffb640 1 -- 172.21.15.167:0/3130723599 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940a5900 con 0x7f9a9c1431c0 2024-09-13T17:20:44.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a99ffb640 1 -- 172.21.15.167:0/3130723599 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a940a5a60 con 0x7f9a9c1431c0 2024-09-13T17:20:44.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.895+0000 7f9a99ffb640 1 -- 172.21.15.167:0/3130723599 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940a5df0 con 0x7f9a9c1431c0 2024-09-13T17:20:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- 172.21.15.167:0/3130723599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 msgr2=0x7f9a9c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3130723599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c0b3da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009d90 tx=0x7f9a9401c8f0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- 172.21.15.167:0/3130723599 shutdown_connections 2024-09-13T17:20:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3130723599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c0b3da0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- 172.21.15.167:0/3130723599 >> 172.21.15.167:0/3130723599 conn(0x7f9a9c09b150 msgr2=0x7f9a9c09b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- 172.21.15.167:0/3130723599 shutdown_connections 2024-09-13T17:20:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- 172.21.15.167:0/3130723599 wait complete. 2024-09-13T17:20:44.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 Processor -- start 2024-09-13T17:20:44.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- start start 2024-09-13T17:20:44.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a9c06d7f0 0x7f9a9c0990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c1dec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a9c1465c0 0x7f9a9c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c09a170 con 0x7f9a9c1431c0 2024-09-13T17:20:44.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c1de1c0 con 0x7f9a9c1465c0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9aa1268640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c13dc00 con 0x7f9a9c06d7f0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c1dec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c1dec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58492/0 (socket says 172.21.15.167:58492) 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 -- 172.21.15.167:0/3085400898 learned_addr learned my addr 172.21.15.167:0/3085400898 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9affd640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a9c06d7f0 0x7f9a9c0990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9b7fe640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a9c1465c0 0x7f9a9c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 -- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a9c06d7f0 msgr2=0x7f9a9c0990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a9c06d7f0 0x7f9a9c0990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 -- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a9c1465c0 msgr2=0x7f9a9c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a9c1465c0 0x7f9a9c06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 -- 172.21.15.167:0/3085400898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94009a70 con 0x7f9a9c1431c0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a9a7fc640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c1dec80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000b3e0 tx=0x7f9a9000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a837fe640 1 -- 172.21.15.167:0/3085400898 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90011830 con 0x7f9a9c1431c0 2024-09-13T17:20:44.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a837fe640 1 -- 172.21.15.167:0/3085400898 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a90011990 con 0x7f9a9c1431c0 2024-09-13T17:20:44.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.899+0000 7f9a837fe640 1 -- 172.21.15.167:0/3085400898 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90011d80 con 0x7f9a9c1431c0 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9c1de480 con 0x7f9a9c1431c0 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9c09a6c0 con 0x7f9a9c1431c0 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9c0b3da0 con 0x7f9a9c1431c0 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9a837fe640 1 -- 172.21.15.167:0/3085400898 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a9001a400 con 0x7f9a9c1431c0 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9a837fe640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a880666c0 0x7f9a88068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9a9affd640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a880666c0 0x7f9a88068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9a837fe640 1 -- 172.21.15.167:0/3085400898 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a90083a50 con 0x7f9a9c1431c0 2024-09-13T17:20:44.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.903+0000 7f9a9affd640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a880666c0 0x7f9a88068b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c000f70 tx=0x7f9a8c007ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:44.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:44.907+0000 7f9a837fe640 1 -- 172.21.15.167:0/3085400898 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a90051250 con 0x7f9a9c1431c0 2024-09-13T17:20:45.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.067+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a9c140da0 con 0x7f9a9c1431c0 2024-09-13T17:20:45.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.067+0000 7f9a837fe640 1 -- 172.21.15.167:0/3085400898 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f9a90054870 con 0x7f9a9c1431c0 2024-09-13T17:20:45.069 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:45.069 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":19,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:42.367647+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a880666c0 msgr2=0x7f9a88068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a880666c0 0x7f9a88068b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c000f70 tx=0x7f9a8c007ba0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 msgr2=0x7f9a9c1dec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c1dec80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000b3e0 tx=0x7f9a9000b8a0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 shutdown_connections 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a880666c0 0x7f9a88068b80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a9c1465c0 0x7f9a9c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a9c1431c0 0x7f9a9c1dec80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 --2- 172.21.15.167:0/3085400898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a9c06d7f0 0x7f9a9c0990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 >> 172.21.15.167:0/3085400898 conn(0x7f9a9c09b150 msgr2=0x7f9a9c071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:45.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 shutdown_connections 2024-09-13T17:20:45.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.071+0000 7f9aa1268640 1 -- 172.21.15.167:0/3085400898 wait complete. 2024-09-13T17:20:45.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:20:45.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:20:45.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.203+0000 7ff4bf7fc640 1 Processor -- start 2024-09-13T17:20:45.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.203+0000 7ff4bf7fc640 1 -- start start 2024-09-13T17:20:45.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.203+0000 7ff4bf7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b809a650 0x7ff4b8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.203+0000 7ff4bf7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4b806a830 0x7ff4b8150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.203+0000 7ff4bf7fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b806a3a0 con 0x7ff4b80bada0 2024-09-13T17:20:45.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.203+0000 7ff4bf7fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b80b6c40 con 0x7ff4b806a830 2024-09-13T17:20:45.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bf7fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8145fd0 con 0x7ff4b809a650 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4b806a830 0x7ff4b8150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4b806a830 0x7ff4b8150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58506/0 (socket says 172.21.15.167:58506) 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 -- 172.21.15.167:0/1648780991 learned_addr learned my addr 172.21.15.167:0/1648780991 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bcd97640 1 --2- 172.21.15.167:0/1648780991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b809a650 0x7ff4b8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 -- 172.21.15.167:0/1648780991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b809a650 msgr2=0x7ff4b8145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 --2- 172.21.15.167:0/1648780991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b809a650 0x7ff4b8145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 -- 172.21.15.167:0/1648780991 >> v1:172.21.15.190:6789/0 conn(0x7ff4b80bada0 legacy=0x7ff4b8099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 -- 172.21.15.167:0/1648780991 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80bb180 con 0x7ff4b806a830 2024-09-13T17:20:45.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bcd97640 1 --2- 172.21.15.167:0/1648780991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b809a650 0x7ff4b8145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:45.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4bdd99640 1 --2- 172.21.15.167:0/1648780991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b8150380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009e50 tx=0x7ff4b001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f1063f39dfb9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:45.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4affff640 1 -- 172.21.15.167:0/1648780991 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00a5880 con 0x7ff4b806a830 2024-09-13T17:20:45.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4affff640 1 -- 172.21.15.167:0/1648780991 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b00a59e0 con 0x7ff4b806a830 2024-09-13T17:20:45.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.207+0000 7ff4affff640 1 -- 172.21.15.167:0/1648780991 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00a5d70 con 0x7ff4b806a830 2024-09-13T17:20:45.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1648780991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 msgr2=0x7ff4b8150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1648780991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b8150380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009e50 tx=0x7ff4b001c9a0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1648780991 shutdown_connections 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1648780991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b8150380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1648780991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b809a650 0x7ff4b8145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1648780991 >> 172.21.15.167:0/1648780991 conn(0x7ff4b80b7e40 msgr2=0x7ff4b80b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1648780991 shutdown_connections 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1648780991 wait complete. 2024-09-13T17:20:45.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 Processor -- start 2024-09-13T17:20:45.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- start start 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b80b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4b80bada0 0x7ff4b81df090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b8142d10 0x7ff4b80b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80b49e0 con 0x7ff4b806a830 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80b2380 con 0x7ff4b80bada0 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80b25f0 con 0x7ff4b8142d10 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b80b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b80b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58510/0 (socket says 172.21.15.167:58510) 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 -- 172.21.15.167:0/1383760996 learned_addr learned my addr 172.21.15.167:0/1383760996 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bdd99640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b8142d10 0x7ff4b80b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bcd97640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4b80bada0 0x7ff4b81df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 -- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b8142d10 msgr2=0x7ff4b80b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b8142d10 0x7ff4b80b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 -- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4b80bada0 msgr2=0x7ff4b81df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4b80bada0 0x7ff4b81df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 -- 172.21.15.167:0/1383760996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0009b30 con 0x7ff4b806a830 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bdd99640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b8142d10 0x7ff4b80b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bcd97640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4b80bada0 0x7ff4b81df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bd598640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b80b0500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c3f0 tx=0x7ff4b400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4adffb640 1 -- 172.21.15.167:0/1383760996 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40052d0 con 0x7ff4b806a830 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4adffb640 1 -- 172.21.15.167:0/1383760996 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4005430 con 0x7ff4b806a830 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b81deb70 con 0x7ff4b806a830 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4adffb640 1 -- 172.21.15.167:0/1383760996 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4003840 con 0x7ff4b806a830 2024-09-13T17:20:45.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b8141e80 con 0x7ff4b806a830 2024-09-13T17:20:45.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.211+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8145a90 con 0x7ff4b806a830 2024-09-13T17:20:45.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.215+0000 7ff4adffb640 1 -- 172.21.15.167:0/1383760996 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4b40039a0 con 0x7ff4b806a830 2024-09-13T17:20:45.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.215+0000 7ff4adffb640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff49c066690 0x7ff49c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.215+0000 7ff4bcd97640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff49c066690 0x7ff49c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.215+0000 7ff4adffb640 1 -- 172.21.15.167:0/1383760996 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4b4083300 con 0x7ff4b806a830 2024-09-13T17:20:45.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.215+0000 7ff4bcd97640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff49c066690 0x7ff49c068b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8143d30 tx=0x7ff4a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:45.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.219+0000 7ff4adffb640 1 -- 172.21.15.167:0/1383760996 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4b4050a50 con 0x7ff4b806a830 2024-09-13T17:20:45.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.363+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4b8143fa0 con 0x7ff4b806a830 2024-09-13T17:20:45.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4adffb640 1 -- 172.21.15.167:0/1383760996 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4b4054070 con 0x7ff4b806a830 2024-09-13T17:20:45.366 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff49c066690 msgr2=0x7ff49c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff49c066690 0x7ff49c068b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8143d30 tx=0x7ff4a8008040 comp rx=0 tx=0).stop 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 msgr2=0x7ff4b80b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b80b0500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c3f0 tx=0x7ff4b400c8b0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 shutdown_connections 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff49c066690 0x7ff49c068b50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4b8142d10 0x7ff4b80b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4b80bada0 0x7ff4b81df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 --2- 172.21.15.167:0/1383760996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b806a830 0x7ff4b80b0500 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 >> 172.21.15.167:0/1383760996 conn(0x7ff4b80b7e40 msgr2=0x7ff4b80b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:45.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 shutdown_connections 2024-09-13T17:20:45.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.367+0000 7ff4bf7fc640 1 -- 172.21.15.167:0/1383760996 wait complete. 2024-09-13T17:20:45.384 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:20:45.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f134c1f5640 1 Processor -- start 2024-09-13T17:20:45.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f134c1f5640 1 -- start start 2024-09-13T17:20:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f134c1f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1344149250 0x7f1344149630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f134c1f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f134406ea40 0x7f1344149b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f134c1f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13440b74b0 con 0x7f1344071830 2024-09-13T17:20:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f134c1f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13440b86e0 con 0x7f134406ea40 2024-09-13T17:20:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f134c1f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13440b8de0 con 0x7f1344149250 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f134406ea40 0x7f1344149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f134406ea40 0x7f1344149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58526/0 (socket says 172.21.15.167:58526) 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 -- 172.21.15.167:0/48970872 learned_addr learned my addr 172.21.15.167:0/48970872 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349f91640 1 --2- 172.21.15.167:0/48970872 >> v2:172.21.15.190:3300/0 conn(0x7f1344149250 0x7f1344149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 -- 172.21.15.167:0/48970872 >> v2:172.21.15.190:3300/0 conn(0x7f1344149250 msgr2=0x7f1344149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1348f8f640 1 -- 172.21.15.167:0/48970872 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239624024 0 0) 0x7f13440b74b0 con 0x7f1344071830 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 --2- 172.21.15.167:0/48970872 >> v2:172.21.15.190:3300/0 conn(0x7f1344149250 0x7f1344149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 -- 172.21.15.167:0/48970872 >> v1:172.21.15.167:6789/0 conn(0x7f1344071830 legacy=0x7f1344071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 -- 172.21.15.167:0/48970872 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344072380 con 0x7f134406ea40 2024-09-13T17:20:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.491+0000 7f1349790640 1 --2- 172.21.15.167:0/48970872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f1344149b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f134409c310 tx=0x7f133401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfb96013e7e9dea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1348f8f640 1 -- 172.21.15.167:0/48970872 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340a7070 con 0x7f134406ea40 2024-09-13T17:20:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1348f8f640 1 -- 172.21.15.167:0/48970872 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13340ab430 con 0x7f134406ea40 2024-09-13T17:20:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1348f8f640 1 -- 172.21.15.167:0/48970872 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340ab7c0 con 0x7f134406ea40 2024-09-13T17:20:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/48970872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 msgr2=0x7f1344149b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 --2- 172.21.15.167:0/48970872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f1344149b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f134409c310 tx=0x7f133401c520 comp rx=0 tx=0).stop 2024-09-13T17:20:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/48970872 shutdown_connections 2024-09-13T17:20:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 --2- 172.21.15.167:0/48970872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f1344149b70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 --2- 172.21.15.167:0/48970872 >> v2:172.21.15.190:3300/0 conn(0x7f1344149250 0x7f1344149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/48970872 >> 172.21.15.167:0/48970872 conn(0x7f134409b250 msgr2=0x7f134409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/48970872 shutdown_connections 2024-09-13T17:20:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/48970872 wait complete. 2024-09-13T17:20:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 Processor -- start 2024-09-13T17:20:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- start start 2024-09-13T17:20:45.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f134409cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1344071830 0x7f13441e1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1344149250 0x7f134409ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13441e2560 con 0x7f134406ea40 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13441e1f10 con 0x7f1344071830 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13441e21f0 con 0x7f1344149250 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f134409cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f134409cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58534/0 (socket says 172.21.15.167:58534) 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 -- 172.21.15.167:0/3275489730 learned_addr learned my addr 172.21.15.167:0/3275489730 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349790640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1344071830 0x7f13441e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 -- 172.21.15.167:0/3275489730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1344149250 msgr2=0x7f134409ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1344149250 0x7f134409ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 -- 172.21.15.167:0/3275489730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1344071830 msgr2=0x7f13441e1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1344071830 0x7f13441e1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 -- 172.21.15.167:0/3275489730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13340094d0 con 0x7f134406ea40 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f1349f91640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f134409cc50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f134000c7f0 tx=0x7f134000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f133a7fc640 1 -- 172.21.15.167:0/3275489730 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340007820 con 0x7f134406ea40 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f133a7fc640 1 -- 172.21.15.167:0/3275489730 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340007980 con 0x7f134406ea40 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134406ce10 con 0x7f134406ea40 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f133a7fc640 1 -- 172.21.15.167:0/3275489730 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340007d30 con 0x7f134406ea40 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1344143aa0 con 0x7f134406ea40 2024-09-13T17:20:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.495+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134409baf0 con 0x7f134406ea40 2024-09-13T17:20:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.499+0000 7f133a7fc640 1 -- 172.21.15.167:0/3275489730 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f13400113f0 con 0x7f134406ea40 2024-09-13T17:20:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.499+0000 7f133a7fc640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1328066690 0x7f1328068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.499+0000 7f133a7fc640 1 -- 172.21.15.167:0/3275489730 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1340083e90 con 0x7f134406ea40 2024-09-13T17:20:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.499+0000 7f1349790640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1328066690 0x7f1328068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.499+0000 7f1349790640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1328066690 0x7f1328068b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f13340af000 tx=0x7f1334008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:45.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.503+0000 7f133a7fc640 1 -- 172.21.15.167:0/3275489730 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f13400515e0 con 0x7f134406ea40 2024-09-13T17:20:45.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.683+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f134409f580 con 0x7f134406ea40 2024-09-13T17:20:45.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.683+0000 7f133a7fc640 1 -- 172.21.15.167:0/3275489730 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f1340054c00 con 0x7f134406ea40 2024-09-13T17:20:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:45.685 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:20:45.685 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 2 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1328066690 msgr2=0x7f1328068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1328066690 0x7f1328068b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f13340af000 tx=0x7f1334008040 comp rx=0 tx=0).stop 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 msgr2=0x7f134409cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f134409cc50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f134000c7f0 tx=0x7f134000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 shutdown_connections 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1328066690 0x7f1328068b50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1344149250 0x7f134409ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1344071830 0x7f13441e1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 --2- 172.21.15.167:0/3275489730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134406ea40 0x7f134409cc50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:45.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 >> 172.21.15.167:0/3275489730 conn(0x7f134409b250 msgr2=0x7f13440990c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:45.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 shutdown_connections 2024-09-13T17:20:45.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:45.687+0000 7f134c1f5640 1 -- 172.21.15.167:0/3275489730 wait complete. 2024-09-13T17:20:47.702 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:20:47.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.827+0000 7fbd9c7e7640 1 Processor -- start 2024-09-13T17:20:47.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9c7e7640 1 -- start start 2024-09-13T17:20:47.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9c7e7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd9406f0f0 0x7fbd940b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:47.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9c7e7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbd94070ff0 0x7fbd9414e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:47.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9c7e7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd94071b10 con 0x7fbd94070bb0 2024-09-13T17:20:47.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9c7e7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9406f7f0 con 0x7fbd9406f0f0 2024-09-13T17:20:47.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9c7e7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd940b0ea0 con 0x7fbd94070ff0 2024-09-13T17:20:47.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd9406f0f0 0x7fbd940b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:47.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd9406f0f0 0x7fbd940b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47120/0 (socket says 172.21.15.167:47120) 2024-09-13T17:20:47.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 -- 172.21.15.167:0/1577288892 learned_addr learned my addr 172.21.15.167:0/1577288892 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:47.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9ad84640 1 --2- 172.21.15.167:0/1577288892 >> v2:172.21.15.190:3300/0 conn(0x7fbd94070ff0 0x7fbd9414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:47.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 -- 172.21.15.167:0/1577288892 >> v2:172.21.15.190:3300/0 conn(0x7fbd94070ff0 msgr2=0x7fbd9414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:47.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 --2- 172.21.15.167:0/1577288892 >> v2:172.21.15.190:3300/0 conn(0x7fbd94070ff0 0x7fbd9414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:47.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 -- 172.21.15.167:0/1577288892 >> v1:172.21.15.190:6789/0 conn(0x7fbd94070bb0 legacy=0x7fbd9413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:47.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 -- 172.21.15.167:0/1577288892 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd94071df0 con 0x7fbd9406f0f0 2024-09-13T17:20:47.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd9a583640 1 --2- 172.21.15.167:0/1577288892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd9406f0f0 0x7fbd940b0960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd9406bca0 tx=0x7fbd8801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fe54eb8efc7570 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:47.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd99581640 1 -- 172.21.15.167:0/1577288892 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880ac620 con 0x7fbd9406f0f0 2024-09-13T17:20:47.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd99581640 1 -- 172.21.15.167:0/1577288892 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd880ac780 con 0x7fbd9406f0f0 2024-09-13T17:20:47.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.831+0000 7fbd99581640 1 -- 172.21.15.167:0/1577288892 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880acb10 con 0x7fbd9406f0f0 2024-09-13T17:20:47.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/1577288892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd9406f0f0 msgr2=0x7fbd940b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:47.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/1577288892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd9406f0f0 0x7fbd940b0960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd9406bca0 tx=0x7fbd8801c3c0 comp rx=0 tx=0).stop 2024-09-13T17:20:47.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/1577288892 shutdown_connections 2024-09-13T17:20:47.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/1577288892 >> v2:172.21.15.190:3300/0 conn(0x7fbd94070ff0 0x7fbd9414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:47.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/1577288892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd9406f0f0 0x7fbd940b0960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:47.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/1577288892 >> 172.21.15.167:0/1577288892 conn(0x7fbd940b7250 msgr2=0x7fbd940b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:47.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/1577288892 shutdown_connections 2024-09-13T17:20:47.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/1577288892 wait complete. 2024-09-13T17:20:47.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 Processor -- start 2024-09-13T17:20:47.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- start start 2024-09-13T17:20:47.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd9406f0f0 0x7fbd94142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:47.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94070bb0 0x7fbd941431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:47.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd94070ff0 0x7fbd94138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94144ba0 con 0x7fbd94070bb0 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94143b60 con 0x7fbd9406f0f0 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94141e90 con 0x7fbd94070ff0 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94070bb0 0x7fbd941431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94070bb0 0x7fbd941431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47126/0 (socket says 172.21.15.167:47126) 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 -- 172.21.15.167:0/4033519206 learned_addr learned my addr 172.21.15.167:0/4033519206 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 -- 172.21.15.167:0/4033519206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd94070ff0 msgr2=0x7fbd94138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd94070ff0 0x7fbd94138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9a583640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd9406f0f0 0x7fbd94142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 -- 172.21.15.167:0/4033519206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd9406f0f0 msgr2=0x7fbd94142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd9406f0f0 0x7fbd94142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 -- 172.21.15.167:0/4033519206 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd880094d0 con 0x7fbd94070bb0 2024-09-13T17:20:47.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd99d82640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94070bb0 0x7fbd941431a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000c7f0 tx=0x7fbd9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:47.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd86ffd640 1 -- 172.21.15.167:0/4033519206 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9000aa50 con 0x7fbd94070bb0 2024-09-13T17:20:47.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd86ffd640 1 -- 172.21.15.167:0/4033519206 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9000abb0 con 0x7fbd94070bb0 2024-09-13T17:20:47.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd94072400 con 0x7fbd94070bb0 2024-09-13T17:20:47.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd86ffd640 1 -- 172.21.15.167:0/4033519206 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90012420 con 0x7fbd94070bb0 2024-09-13T17:20:47.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.835+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd94142220 con 0x7fbd94070bb0 2024-09-13T17:20:47.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.839+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd94072260 con 0x7fbd94070bb0 2024-09-13T17:20:47.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.839+0000 7fbd86ffd640 1 -- 172.21.15.167:0/4033519206 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd90012580 con 0x7fbd94070bb0 2024-09-13T17:20:47.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.839+0000 7fbd86ffd640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd78066690 0x7fbd78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:47.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.839+0000 7fbd86ffd640 1 -- 172.21.15.167:0/4033519206 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd90083fa0 con 0x7fbd94070bb0 2024-09-13T17:20:47.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.839+0000 7fbd9a583640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd78066690 0x7fbd78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:47.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.839+0000 7fbd9a583640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd78066690 0x7fbd78068b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbd880ae000 tx=0x7fbd88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:47.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:47.843+0000 7fbd86ffd640 1 -- 172.21.15.167:0/4033519206 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd900b5db0 con 0x7fbd94070bb0 2024-09-13T17:20:48.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.035+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd941423b0 con 0x7fbd94070bb0 2024-09-13T17:20:48.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.035+0000 7fbd86ffd640 1 -- 172.21.15.167:0/4033519206 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2015 (secure 0 0 0) 0x7fbd941423b0 con 0x7fbd94070bb0 2024-09-13T17:20:48.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:48.037 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:20:48.037 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 3 2024-09-13T17:20:48.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd78066690 msgr2=0x7fbd78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd78066690 0x7fbd78068b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbd880ae000 tx=0x7fbd88008040 comp rx=0 tx=0).stop 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94070bb0 msgr2=0x7fbd941431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94070bb0 0x7fbd941431a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000c7f0 tx=0x7fbd9000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 shutdown_connections 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd78066690 0x7fbd78068b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd94070ff0 0x7fbd94138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94070bb0 0x7fbd941431a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 --2- 172.21.15.167:0/4033519206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd9406f0f0 0x7fbd94142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 >> 172.21.15.167:0/4033519206 conn(0x7fbd940b7250 msgr2=0x7fbd940b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 shutdown_connections 2024-09-13T17:20:48.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.039+0000 7fbd9c7e7640 1 -- 172.21.15.167:0/4033519206 wait complete. 2024-09-13T17:20:48.056 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:48.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae99698640 1 Processor -- start 2024-09-13T17:20:48.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae99698640 1 -- start start 2024-09-13T17:20:48.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae99698640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae940b1eb0 0x7fae940b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae99698640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae94145cb0 0x7fae940b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae99698640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940b00b0 con 0x7fae9413f9d0 2024-09-13T17:20:48.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae99698640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae940b2290 con 0x7fae94145cb0 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae99698640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940b1580 con 0x7fae940b1eb0 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae927fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae94145cb0 0x7fae940b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae927fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae94145cb0 0x7fae940b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47138/0 (socket says 172.21.15.167:47138) 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae927fc640 1 -- 172.21.15.167:0/3894375232 learned_addr learned my addr 172.21.15.167:0/3894375232 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae92ffd640 1 --2- 172.21.15.167:0/3894375232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae940b1eb0 0x7fae940b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae927fc640 1 -- 172.21.15.167:0/3894375232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae940b1eb0 msgr2=0x7fae940b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae927fc640 1 --2- 172.21.15.167:0/3894375232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae940b1eb0 0x7fae940b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae927fc640 1 -- 172.21.15.167:0/3894375232 >> v1:172.21.15.190:6789/0 conn(0x7fae9413f9d0 legacy=0x7fae940ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:48.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.171+0000 7fae927fc640 1 -- 172.21.15.167:0/3894375232 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9406f600 con 0x7fae94145cb0 2024-09-13T17:20:48.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae927fc640 1 --2- 172.21.15.167:0/3894375232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae94145cb0 0x7fae940b1040 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae84009870 tx=0x7fae8401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3bcef8a234a743 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae91ffb640 1 -- 172.21.15.167:0/3894375232 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840ab600 con 0x7fae94145cb0 2024-09-13T17:20:48.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae91ffb640 1 -- 172.21.15.167:0/3894375232 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae840a7050 con 0x7fae94145cb0 2024-09-13T17:20:48.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae91ffb640 1 -- 172.21.15.167:0/3894375232 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840ab980 con 0x7fae94145cb0 2024-09-13T17:20:48.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 -- 172.21.15.167:0/3894375232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae94145cb0 msgr2=0x7fae940b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 --2- 172.21.15.167:0/3894375232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae94145cb0 0x7fae940b1040 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae84009870 tx=0x7fae8401c490 comp rx=0 tx=0).stop 2024-09-13T17:20:48.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 -- 172.21.15.167:0/3894375232 shutdown_connections 2024-09-13T17:20:48.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 --2- 172.21.15.167:0/3894375232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae94145cb0 0x7fae940b1040 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 --2- 172.21.15.167:0/3894375232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae940b1eb0 0x7fae940b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 -- 172.21.15.167:0/3894375232 >> 172.21.15.167:0/3894375232 conn(0x7fae940b7250 msgr2=0x7fae940b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:48.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 -- 172.21.15.167:0/3894375232 shutdown_connections 2024-09-13T17:20:48.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 -- 172.21.15.167:0/3894375232 wait complete. 2024-09-13T17:20:48.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 Processor -- start 2024-09-13T17:20:48.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.175+0000 7fae99698640 1 -- start start 2024-09-13T17:20:48.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae940b1eb0 0x7fae94144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae9413f9d0 0x7fae941dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae94145cb0 0x7fae941e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae940a8fc0 con 0x7fae940b1eb0 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae941df740 con 0x7fae9413f9d0 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940a9480 con 0x7fae94145cb0 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae940b1eb0 0x7fae94144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae940b1eb0 0x7fae94144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47152/0 (socket says 172.21.15.167:47152) 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 -- 172.21.15.167:0/1410684828 learned_addr learned my addr 172.21.15.167:0/1410684828 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae927fc640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae9413f9d0 0x7fae941dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae937fe640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae94145cb0 0x7fae941e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 -- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae94145cb0 msgr2=0x7fae941e0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae94145cb0 0x7fae941e0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 -- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae9413f9d0 msgr2=0x7fae941dfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae9413f9d0 0x7fae941dfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 -- 172.21.15.167:0/1410684828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840094d0 con 0x7fae940b1eb0 2024-09-13T17:20:48.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae92ffd640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae940b1eb0 0x7fae94144c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c7f0 tx=0x7fae8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae7b7fe640 1 -- 172.21.15.167:0/1410684828 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88007820 con 0x7fae940b1eb0 2024-09-13T17:20:48.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae7b7fe640 1 -- 172.21.15.167:0/1410684828 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae88007980 con 0x7fae940b1eb0 2024-09-13T17:20:48.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9413c0c0 con 0x7fae940b1eb0 2024-09-13T17:20:48.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae7b7fe640 1 -- 172.21.15.167:0/1410684828 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88007d70 con 0x7fae940b1eb0 2024-09-13T17:20:48.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9413c3a0 con 0x7fae940b1eb0 2024-09-13T17:20:48.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae940b0540 con 0x7fae940b1eb0 2024-09-13T17:20:48.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae7b7fe640 1 -- 172.21.15.167:0/1410684828 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae88004020 con 0x7fae940b1eb0 2024-09-13T17:20:48.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae7b7fe640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fae80066690 0x7fae80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae7b7fe640 1 -- 172.21.15.167:0/1410684828 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae880844c0 con 0x7fae940b1eb0 2024-09-13T17:20:48.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae927fc640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fae80066690 0x7fae80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.179+0000 7fae927fc640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fae80066690 0x7fae80068b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae840ad000 tx=0x7fae840a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.183+0000 7fae7b7fe640 1 -- 172.21.15.167:0/1410684828 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fae88051cf0 con 0x7fae940b1eb0 2024-09-13T17:20:48.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.343+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae940b1020 con 0x7fae940b1eb0 2024-09-13T17:20:48.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.343+0000 7fae7b7fe640 1 -- 172.21.15.167:0/1410684828 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fae8801f090 con 0x7fae940b1eb0 2024-09-13T17:20:48.346 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:48.346 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":19,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:42.367647+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fae80066690 msgr2=0x7fae80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fae80066690 0x7fae80068b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae840ad000 tx=0x7fae840a6000 comp rx=0 tx=0).stop 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae940b1eb0 msgr2=0x7fae94144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae940b1eb0 0x7fae94144c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c7f0 tx=0x7fae8800ccb0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 shutdown_connections 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fae80066690 0x7fae80068b50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae94145cb0 0x7fae941e0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae9413f9d0 0x7fae941dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 --2- 172.21.15.167:0/1410684828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae940b1eb0 0x7fae94144c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 >> 172.21.15.167:0/1410684828 conn(0x7fae940b7250 msgr2=0x7fae941462e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:48.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 shutdown_connections 2024-09-13T17:20:48.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.347+0000 7fae99698640 1 -- 172.21.15.167:0/1410684828 wait complete. 2024-09-13T17:20:48.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:20:48.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:20:48.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.483+0000 7f36b362b640 1 Processor -- start 2024-09-13T17:20:48.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.483+0000 7f36b362b640 1 -- start start 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36ac09a650 0x7f36ac145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac06a3a0 con 0x7f36ac06a830 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac145fd0 con 0x7f36ac0bada0 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac0b6c40 con 0x7f36ac09a650 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b0bc6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36ac09a650 0x7f36ac145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b1bc8640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f36ac06a830 0x7f36ac150380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44890/0 (socket says 172.21.15.167:44890) 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b1bc8640 1 -- 172.21.15.167:0/796797558 learned_addr learned my addr 172.21.15.167:0/796797558 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b0bc6640 1 -- 172.21.15.167:0/796797558 >> v1:172.21.15.190:6789/0 conn(0x7f36ac0bada0 legacy=0x7f36ac099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:48.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b0bc6640 1 -- 172.21.15.167:0/796797558 >> v1:172.21.15.167:6789/0 conn(0x7f36ac06a830 legacy=0x7f36ac150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b0bc6640 1 -- 172.21.15.167:0/796797558 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0bb180 con 0x7f36ac09a650 2024-09-13T17:20:48.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b0bc6640 1 --2- 172.21.15.167:0/796797558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac09a650 0x7f36ac145a90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097c0 tx=0x7f369c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0458592677503ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36a3fff640 1 -- 172.21.15.167:0/796797558 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0ab600 con 0x7f36ac09a650 2024-09-13T17:20:48.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36a3fff640 1 -- 172.21.15.167:0/796797558 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c0a7050 con 0x7f36ac09a650 2024-09-13T17:20:48.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36a3fff640 1 -- 172.21.15.167:0/796797558 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0ab980 con 0x7f36ac09a650 2024-09-13T17:20:48.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- 172.21.15.167:0/796797558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac09a650 msgr2=0x7f36ac145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 --2- 172.21.15.167:0/796797558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac09a650 0x7f36ac145a90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097c0 tx=0x7f369c01c260 comp rx=0 tx=0).stop 2024-09-13T17:20:48.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- 172.21.15.167:0/796797558 shutdown_connections 2024-09-13T17:20:48.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 --2- 172.21.15.167:0/796797558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac09a650 0x7f36ac145a90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- 172.21.15.167:0/796797558 >> 172.21.15.167:0/796797558 conn(0x7f36ac0b7e40 msgr2=0x7f36ac0b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:48.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- 172.21.15.167:0/796797558 shutdown_connections 2024-09-13T17:20:48.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.487+0000 7f36b362b640 1 -- 172.21.15.167:0/796797558 wait complete. 2024-09-13T17:20:48.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 Processor -- start 2024-09-13T17:20:48.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 -- start start 2024-09-13T17:20:48.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36ac06a830 0x7f36ac1425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac0bada0 0x7f36ac1dec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36ac1df1b0 0x7f36ac13ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0b3720 con 0x7f36ac0bada0 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0b43a0 con 0x7f36ac1df1b0 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1df630 con 0x7f36ac06a830 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac0bada0 0x7f36ac1dec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac0bada0 0x7f36ac1dec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47178/0 (socket says 172.21.15.167:47178) 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 -- 172.21.15.167:0/435350445 learned_addr learned my addr 172.21.15.167:0/435350445 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b13c7640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36ac06a830 0x7f36ac1425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b1bc8640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36ac1df1b0 0x7f36ac13ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 -- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36ac06a830 msgr2=0x7f36ac1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36ac06a830 0x7f36ac1425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 -- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36ac1df1b0 msgr2=0x7f36ac13ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36ac1df1b0 0x7f36ac13ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 -- 172.21.15.167:0/435350445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c009420 con 0x7f36ac0bada0 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b1bc8640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36ac1df1b0 0x7f36ac13ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b0bc6640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac0bada0 0x7f36ac1dec70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f369c019e90 tx=0x7f369c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36a1ffb640 1 -- 172.21.15.167:0/435350445 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0b4840 con 0x7f36ac0bada0 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36a1ffb640 1 -- 172.21.15.167:0/435350445 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c0b49c0 con 0x7f36ac0bada0 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac0b4880 con 0x7f36ac0bada0 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36a1ffb640 1 -- 172.21.15.167:0/435350445 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0b4d70 con 0x7f36ac0bada0 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac0b3340 con 0x7f36ac0bada0 2024-09-13T17:20:48.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.491+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0b3860 con 0x7f36ac0bada0 2024-09-13T17:20:48.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.495+0000 7f36a1ffb640 1 -- 172.21.15.167:0/435350445 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f369c0b2040 con 0x7f36ac0bada0 2024-09-13T17:20:48.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.495+0000 7f36a1ffb640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3690066690 0x7f3690068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.495+0000 7f36a1ffb640 1 -- 172.21.15.167:0/435350445 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f369c11e140 con 0x7f36ac0bada0 2024-09-13T17:20:48.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.495+0000 7f36b13c7640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3690066690 0x7f3690068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.495+0000 7f36b13c7640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3690066690 0x7f3690068b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f36a400b810 tx=0x7f36a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.499+0000 7f36a1ffb640 1 -- 172.21.15.167:0/435350445 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f369c0eb890 con 0x7f36ac0bada0 2024-09-13T17:20:48.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36ac145a90 con 0x7f36ac0bada0 2024-09-13T17:20:48.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36a1ffb640 1 -- 172.21.15.167:0/435350445 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f369c0b8020 con 0x7f36ac0bada0 2024-09-13T17:20:48.660 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3690066690 msgr2=0x7f3690068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3690066690 0x7f3690068b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f36a400b810 tx=0x7f36a4008040 comp rx=0 tx=0).stop 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac0bada0 msgr2=0x7f36ac1dec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac0bada0 0x7f36ac1dec70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f369c019e90 tx=0x7f369c019000 comp rx=0 tx=0).stop 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 shutdown_connections 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3690066690 0x7f3690068b50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36ac1df1b0 0x7f36ac13ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36ac0bada0 0x7f36ac1dec70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 --2- 172.21.15.167:0/435350445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36ac06a830 0x7f36ac1425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 >> 172.21.15.167:0/435350445 conn(0x7f36ac0b7e40 msgr2=0x7f36ac1441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:48.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.659+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 shutdown_connections 2024-09-13T17:20:48.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.663+0000 7f36b362b640 1 -- 172.21.15.167:0/435350445 wait complete. 2024-09-13T17:20:48.679 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:20:48.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb81bd4640 1 Processor -- start 2024-09-13T17:20:48.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb81bd4640 1 -- start start 2024-09-13T17:20:48.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb81bd4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdb7c071c00 0x7fdb7c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb81bd4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c13d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb81bd4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0b05f0 con 0x7fdb7c146ca0 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb81bd4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c0b3210 con 0x7fdb7c071c00 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb81bd4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c071fe0 con 0x7fdb7c13d220 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c13d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7b7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdb7c071c00 0x7fdb7c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c13d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.167:38960/0 (socket says 172.21.15.167:38960) 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7b7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdb7c071c00 0x7fdb7c0b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:56980/0 (socket says 172.21.15.167:56980) 2024-09-13T17:20:48.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7bfff640 1 -- 172.21.15.167:0/1599809613 learned_addr learned my addr 172.21.15.167:0/1599809613 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:48.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7bfff640 1 -- 172.21.15.167:0/1599809613 >> v2:172.21.15.190:3300/0 conn(0x7fdb7c071c00 msgr2=0x7fdb7c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:48.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7bfff640 1 --2- 172.21.15.167:0/1599809613 >> v2:172.21.15.190:3300/0 conn(0x7fdb7c071c00 0x7fdb7c0b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7bfff640 1 -- 172.21.15.167:0/1599809613 >> v1:172.21.15.190:6789/0 conn(0x7fdb7c146ca0 legacy=0x7fdb7c147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7bfff640 1 -- 172.21.15.167:0/1599809613 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0b34b0 con 0x7fdb7c13d220 2024-09-13T17:20:48.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.783+0000 7fdb7b7fe640 1 --2- 172.21.15.167:0/1599809613 >> v2:172.21.15.190:3300/0 conn(0x7fdb7c071c00 0x7fdb7c0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:48.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb7bfff640 1 --2- 172.21.15.167:0/1599809613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c13d650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009e50 tx=0x7fdb7401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=480582d8a38dec8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb7a7fc640 1 -- 172.21.15.167:0/1599809613 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740a56e0 con 0x7fdb7c13d220 2024-09-13T17:20:48.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb7a7fc640 1 -- 172.21.15.167:0/1599809613 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb740a5840 con 0x7fdb7c13d220 2024-09-13T17:20:48.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb7a7fc640 1 -- 172.21.15.167:0/1599809613 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740a5bd0 con 0x7fdb7c13d220 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1599809613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 msgr2=0x7fdb7c13d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1599809613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c13d650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009e50 tx=0x7fdb7401c9a0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1599809613 shutdown_connections 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1599809613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c13d650 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1599809613 >> v2:172.21.15.190:3300/0 conn(0x7fdb7c071c00 0x7fdb7c0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1599809613 >> 172.21.15.167:0/1599809613 conn(0x7fdb7c0b8260 msgr2=0x7fdb7c0b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1599809613 shutdown_connections 2024-09-13T17:20:48.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.787+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1599809613 wait complete. 2024-09-13T17:20:48.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 Processor -- start 2024-09-13T17:20:48.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 -- start start 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb7c071c00 0x7fdb7c06f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7c146ca0 0x7fdb7c1e1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c13fdb0 con 0x7fdb7c071c00 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c140370 con 0x7fdb7c146ca0 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c070f30 con 0x7fdb7c13d220 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb7c071c00 0x7fdb7c06f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb7c071c00 0x7fdb7c06f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47192/0 (socket says 172.21.15.167:47192) 2024-09-13T17:20:48.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 -- 172.21.15.167:0/1128552472 learned_addr learned my addr 172.21.15.167:0/1128552472 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7bfff640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7c146ca0 0x7fdb7c1e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7affd640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 -- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 msgr2=0x7fdb7c140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 -- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7c146ca0 msgr2=0x7fdb7c1e1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7c146ca0 0x7fdb7c1e1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 -- 172.21.15.167:0/1128552472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c009420 con 0x7fdb7c071c00 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7b7fe640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb7c071c00 0x7fdb7c06f9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00ebe0 tx=0x7fdb6c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb63fff640 1 -- 172.21.15.167:0/1128552472 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00eee0 con 0x7fdb7c071c00 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb63fff640 1 -- 172.21.15.167:0/1128552472 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c00cc30 con 0x7fdb7c071c00 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb74009b30 con 0x7fdb7c071c00 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb63fff640 1 -- 172.21.15.167:0/1128552472 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c013470 con 0x7fdb7c071c00 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c06ff30 con 0x7fdb7c071c00 2024-09-13T17:20:48.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c13ff20 con 0x7fdb7c071c00 2024-09-13T17:20:48.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb63fff640 1 -- 172.21.15.167:0/1128552472 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdb6c0135d0 con 0x7fdb7c071c00 2024-09-13T17:20:48.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb63fff640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fdb68066690 0x7fdb68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:48.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb63fff640 1 -- 172.21.15.167:0/1128552472 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb6c084140 con 0x7fdb7c071c00 2024-09-13T17:20:48.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.791+0000 7fdb7affd640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fdb68066690 0x7fdb68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:48.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.795+0000 7fdb7affd640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fdb68066690 0x7fdb68068b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb70007fd0 tx=0x7fdb70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:48.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.799+0000 7fdb63fff640 1 -- 172.21.15.167:0/1128552472 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdb7c13ff20 con 0x7fdb7c071c00 2024-09-13T17:20:48.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.955+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdb7c140110 con 0x7fdb7c071c00 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.955+0000 7fdb63fff640 1 -- 172.21.15.167:0/1128552472 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdb6c0552a0 con 0x7fdb7c071c00 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stdout:[ 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stdout: "poolnum": 1, 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stdout: "poolname": ".mgr" 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-13T17:20:48.958 INFO:teuthology.orchestra.run.smithi167.stdout:] 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fdb68066690 msgr2=0x7fdb68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fdb68066690 0x7fdb68068b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb70007fd0 tx=0x7fdb70009040 comp rx=0 tx=0).stop 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb7c071c00 msgr2=0x7fdb7c06f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb7c071c00 0x7fdb7c06f9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00ebe0 tx=0x7fdb6c00c520 comp rx=0 tx=0).stop 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 shutdown_connections 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fdb68066690 0x7fdb68068b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7c146ca0 0x7fdb7c1e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb7c13d220 0x7fdb7c140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 --2- 172.21.15.167:0/1128552472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb7c071c00 0x7fdb7c06f9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:48.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 >> 172.21.15.167:0/1128552472 conn(0x7fdb7c0b8260 msgr2=0x7fdb7c0b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:48.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 shutdown_connections 2024-09-13T17:20:48.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:48.959+0000 7fdb81bd4640 1 -- 172.21.15.167:0/1128552472 wait complete. 2024-09-13T17:20:48.975 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:20:48.975 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:20:49.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9bb82640 1 Processor -- start 2024-09-13T17:20:49.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9bb82640 1 -- start start 2024-09-13T17:20:49.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9bb82640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3e940bada0 0x7f3e94145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9bb82640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e9409a650 0x7f3e94150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9bb82640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9406a3a0 con 0x7f3e9406a830 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9bb82640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e940b6c40 con 0x7f3e9409a650 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9bb82640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e94145fd0 con 0x7f3e940bada0 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9a11f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e9409a650 0x7f3e94150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9911d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3e9406a830 0x7f3e94099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44906/0 (socket says 172.21.15.167:44906) 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.087+0000 7f3e9911d640 1 -- 172.21.15.167:0/3617603161 learned_addr learned my addr 172.21.15.167:0/3617603161 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9991e640 1 --2- 172.21.15.167:0/3617603161 >> v2:172.21.15.190:3300/0 conn(0x7f3e940bada0 0x7f3e94145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9a11f640 1 -- 172.21.15.167:0/3617603161 >> v2:172.21.15.190:3300/0 conn(0x7f3e940bada0 msgr2=0x7f3e94145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9a11f640 1 --2- 172.21.15.167:0/3617603161 >> v2:172.21.15.190:3300/0 conn(0x7f3e940bada0 0x7f3e94145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9891c640 1 -- 172.21.15.167:0/3617603161 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663253068 0 0) 0x7f3e9406a3a0 con 0x7f3e9406a830 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9a11f640 1 -- 172.21.15.167:0/3617603161 >> v1:172.21.15.167:6789/0 conn(0x7f3e9406a830 legacy=0x7f3e94099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9a11f640 1 -- 172.21.15.167:0/3617603161 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940bb180 con 0x7f3e9409a650 2024-09-13T17:20:49.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9a11f640 1 --2- 172.21.15.167:0/3617603161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9409a650 0x7f3e94150380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3e94066cf0 tx=0x7f3e8c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e8e3b463dafafa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:49.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9891c640 1 -- 172.21.15.167:0/3617603161 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0a5980 con 0x7f3e9409a650 2024-09-13T17:20:49.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9891c640 1 -- 172.21.15.167:0/3617603161 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c0a5ae0 con 0x7f3e9409a650 2024-09-13T17:20:49.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9891c640 1 -- 172.21.15.167:0/3617603161 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0a5e70 con 0x7f3e9409a650 2024-09-13T17:20:49.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3617603161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9409a650 msgr2=0x7f3e94150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3617603161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9409a650 0x7f3e94150380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3e94066cf0 tx=0x7f3e8c01c8a0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3617603161 shutdown_connections 2024-09-13T17:20:49.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3617603161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9409a650 0x7f3e94150380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3617603161 >> v2:172.21.15.190:3300/0 conn(0x7f3e940bada0 0x7f3e94145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3617603161 >> 172.21.15.167:0/3617603161 conn(0x7f3e940b7e40 msgr2=0x7f3e940b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:49.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3617603161 shutdown_connections 2024-09-13T17:20:49.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.091+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3617603161 wait complete. 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 Processor -- start 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 -- start start 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9406a830 0x7f3e940b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e940bada0 0x7f3e941e1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e940b51c0 0x7f3e941e1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e941e13a0 con 0x7f3e9406a830 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940b4500 con 0x7f3e940b51c0 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940b4220 con 0x7f3e940bada0 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9406a830 0x7f3e940b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9406a830 0x7f3e940b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47212/0 (socket says 172.21.15.167:47212) 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 -- 172.21.15.167:0/3810408440 learned_addr learned my addr 172.21.15.167:0/3810408440 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 -- 172.21.15.167:0/3810408440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e940bada0 msgr2=0x7f3e941e1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e940bada0 0x7f3e941e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 -- 172.21.15.167:0/3810408440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e940b51c0 msgr2=0x7f3e941e1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e940b51c0 0x7f3e941e1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 -- 172.21.15.167:0/3810408440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c009a70 con 0x7f3e9406a830 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9991e640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9406a830 0x7f3e940b4c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000d5f0 tx=0x7f3e9000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e8a7fc640 1 -- 172.21.15.167:0/3810408440 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e900125f0 con 0x7f3e9406a830 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e8a7fc640 1 -- 172.21.15.167:0/3810408440 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e90012750 con 0x7f3e9406a830 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940b5630 con 0x7f3e9406a830 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e8a7fc640 1 -- 172.21.15.167:0/3810408440 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90012ae0 con 0x7f3e9406a830 2024-09-13T17:20:49.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e94142eb0 con 0x7f3e9406a830 2024-09-13T17:20:49.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e94144310 con 0x7f3e9406a830 2024-09-13T17:20:49.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e8a7fc640 1 -- 172.21.15.167:0/3810408440 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e90012c40 con 0x7f3e9406a830 2024-09-13T17:20:49.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e8a7fc640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3e78066690 0x7f3e78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.095+0000 7f3e9911d640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3e78066690 0x7f3e78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.099+0000 7f3e8a7fc640 1 -- 172.21.15.167:0/3810408440 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e90084350 con 0x7f3e9406a830 2024-09-13T17:20:49.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.099+0000 7f3e9911d640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3e78066690 0x7f3e78068b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e840011f0 tx=0x7f3e84007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:49.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.103+0000 7f3e8a7fc640 1 -- 172.21.15.167:0/3810408440 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e90051aa0 con 0x7f3e9406a830 2024-09-13T17:20:49.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.247+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3e94145a90 con 0x7f3e9406a830 2024-09-13T17:20:49.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.559+0000 7f3e8a7fc640 1 -- 172.21.15.167:0/3810408440 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3e90007380 con 0x7f3e9406a830 2024-09-13T17:20:49.561 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_metadata' created 2024-09-13T17:20:49.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3e78066690 msgr2=0x7f3e78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3e78066690 0x7f3e78068b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e840011f0 tx=0x7f3e84007930 comp rx=0 tx=0).stop 2024-09-13T17:20:49.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9406a830 msgr2=0x7f3e940b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9406a830 0x7f3e940b4c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000d5f0 tx=0x7f3e9000dab0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 shutdown_connections 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3e78066690 0x7f3e78068b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e940b51c0 0x7f3e941e1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e940bada0 0x7f3e941e1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 --2- 172.21.15.167:0/3810408440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9406a830 0x7f3e940b4c80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 >> 172.21.15.167:0/3810408440 conn(0x7f3e940b7e40 msgr2=0x7f3e9409b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 shutdown_connections 2024-09-13T17:20:49.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.563+0000 7f3e9bb82640 1 -- 172.21.15.167:0/3810408440 wait complete. 2024-09-13T17:20:49.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T17:20:49.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fe724640 1 Processor -- start 2024-09-13T17:20:49.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fe724640 1 -- start start 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fe724640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f26f80992d0 0x7f26f80ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fe724640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26f8142d70 0x7f26f814c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fe724640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80ae2a0 con 0x7f26f80996b0 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fe724640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f80b34c0 con 0x7f26f8142d70 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fe724640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f80ad4e0 con 0x7f26f80992d0 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fccc1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26f8142d70 0x7f26f814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26effff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f26f80996b0 0x7f26f8142660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44920/0 (socket says 172.21.15.167:44920) 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fccc1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26f8142d70 0x7f26f814c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47218/0 (socket says 172.21.15.167:47218) 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26effff640 1 -- 172.21.15.167:0/3489786346 learned_addr learned my addr 172.21.15.167:0/3489786346 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26f7fff640 1 --2- 172.21.15.167:0/3489786346 >> v2:172.21.15.190:3300/0 conn(0x7f26f80992d0 0x7f26f80ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fccc1640 1 -- 172.21.15.167:0/3489786346 >> v2:172.21.15.190:3300/0 conn(0x7f26f80992d0 msgr2=0x7f26f80ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fccc1640 1 --2- 172.21.15.167:0/3489786346 >> v2:172.21.15.190:3300/0 conn(0x7f26f80992d0 0x7f26f80ac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fccc1640 1 -- 172.21.15.167:0/3489786346 >> v1:172.21.15.167:6789/0 conn(0x7f26f80996b0 legacy=0x7f26f8142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.719+0000 7f26fccc1640 1 -- 172.21.15.167:0/3489786346 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80ad7c0 con 0x7f26f8142d70 2024-09-13T17:20:49.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fccc1640 1 --2- 172.21.15.167:0/3489786346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f8142d70 0x7f26f814c930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26f806b060 tx=0x7f26f001d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbff081478e8b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:49.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26f77fe640 1 -- 172.21.15.167:0/3489786346 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000a2d0 con 0x7f26f8142d70 2024-09-13T17:20:49.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26f77fe640 1 -- 172.21.15.167:0/3489786346 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00a66c0 con 0x7f26f8142d70 2024-09-13T17:20:49.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26f77fe640 1 -- 172.21.15.167:0/3489786346 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00a6a50 con 0x7f26f8142d70 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 -- 172.21.15.167:0/3489786346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f8142d70 msgr2=0x7f26f814c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 --2- 172.21.15.167:0/3489786346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f8142d70 0x7f26f814c930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26f806b060 tx=0x7f26f001d850 comp rx=0 tx=0).stop 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 -- 172.21.15.167:0/3489786346 shutdown_connections 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 --2- 172.21.15.167:0/3489786346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f8142d70 0x7f26f814c930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 --2- 172.21.15.167:0/3489786346 >> v2:172.21.15.190:3300/0 conn(0x7f26f80992d0 0x7f26f80ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 -- 172.21.15.167:0/3489786346 >> 172.21.15.167:0/3489786346 conn(0x7f26f80b3b50 msgr2=0x7f26f80b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 -- 172.21.15.167:0/3489786346 shutdown_connections 2024-09-13T17:20:49.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 -- 172.21.15.167:0/3489786346 wait complete. 2024-09-13T17:20:49.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 Processor -- start 2024-09-13T17:20:49.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.723+0000 7f26fe724640 1 -- start start 2024-09-13T17:20:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26f80992d0 0x7f26f809b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f80996b0 0x7f26f81d6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26f8142d70 0x7f26f80b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f81d7ea0 con 0x7f26f80996b0 2024-09-13T17:20:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f81d7850 con 0x7f26f8142d70 2024-09-13T17:20:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f81d7b30 con 0x7f26f80992d0 2024-09-13T17:20:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f80996b0 0x7f26f81d6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f80996b0 0x7f26f81d6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47224/0 (socket says 172.21.15.167:47224) 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 -- 172.21.15.167:0/3876432374 learned_addr learned my addr 172.21.15.167:0/3876432374 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fccc1640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26f8142d70 0x7f26f80b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f7fff640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26f80992d0 0x7f26f809b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 -- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26f80992d0 msgr2=0x7f26f809b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26f80992d0 0x7f26f809b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 -- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26f8142d70 msgr2=0x7f26f80b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26f8142d70 0x7f26f80b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 -- 172.21.15.167:0/3876432374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f000ab80 con 0x7f26f80996b0 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fccc1640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26f8142d70 0x7f26f80b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26effff640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f80996b0 0x7f26f81d6f80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009ec0 tx=0x7f26e000c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f57fa640 1 -- 172.21.15.167:0/3876432374 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0007af0 con 0x7f26f80996b0 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f57fa640 1 -- 172.21.15.167:0/3876432374 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e0007c50 con 0x7f26f80996b0 2024-09-13T17:20:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f81d74c0 con 0x7f26f80996b0 2024-09-13T17:20:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f57fa640 1 -- 172.21.15.167:0/3876432374 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000ce10 con 0x7f26f80996b0 2024-09-13T17:20:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f80aec80 con 0x7f26f80996b0 2024-09-13T17:20:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f80b0340 con 0x7f26f80996b0 2024-09-13T17:20:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f57fa640 1 -- 172.21.15.167:0/3876432374 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26e0009070 con 0x7f26f80996b0 2024-09-13T17:20:49.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f57fa640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f26d8066690 0x7f26d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:49.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f57fa640 1 -- 172.21.15.167:0/3876432374 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f26e00860a0 con 0x7f26f80996b0 2024-09-13T17:20:49.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.727+0000 7f26f7fff640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f26d8066690 0x7f26d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:49.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.731+0000 7f26f7fff640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f26d8066690 0x7f26d8068b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26e80096f0 tx=0x7f26e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:49.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.731+0000 7f26f57fa640 1 -- 172.21.15.167:0/3876432374 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26e0053760 con 0x7f26f80996b0 2024-09-13T17:20:49.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:49.891+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f26f80b0340 con 0x7f26f80996b0 2024-09-13T17:20:50.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.563+0000 7f26f57fa640 1 -- 172.21.15.167:0/3876432374 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f26f80b0340 con 0x7f26f80996b0 2024-09-13T17:20:50.572 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data' created 2024-09-13T17:20:50.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f26d8066690 msgr2=0x7f26d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f26d8066690 0x7f26d8068b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26e80096f0 tx=0x7f26e8008040 comp rx=0 tx=0).stop 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f80996b0 msgr2=0x7f26f81d6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f80996b0 0x7f26f81d6f80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009ec0 tx=0x7f26e000c430 comp rx=0 tx=0).stop 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 shutdown_connections 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f26d8066690 0x7f26d8068b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26f8142d70 0x7f26f80b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f80996b0 0x7f26f81d6f80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 --2- 172.21.15.167:0/3876432374 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26f80992d0 0x7f26f809b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 >> 172.21.15.167:0/3876432374 conn(0x7f26f80b3b50 msgr2=0x7f26f8140ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:50.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 shutdown_connections 2024-09-13T17:20:50.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.579+0000 7f26fe724640 1 -- 172.21.15.167:0/3876432374 wait complete. 2024-09-13T17:20:50.608 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:20:50.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd79f11640 1 Processor -- start 2024-09-13T17:20:50.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd79f11640 1 -- start start 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd79f11640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd741473b0 0x7fcd74147840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd79f11640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd740b3a00 con 0x7fcd74065c80 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd79f11640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd740aea70 con 0x7fcd74066060 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd79f11640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd74144700 con 0x7fcd741473b0 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd737fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcd74065c80 0x7fcd74143c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44934/0 (socket says 172.21.15.167:44934) 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd737fe640 1 -- 172.21.15.167:0/3257080005 learned_addr learned my addr 172.21.15.167:0/3257080005 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd73fff640 1 --2- 172.21.15.167:0/3257080005 >> v2:172.21.15.190:3300/0 conn(0x7fcd741473b0 0x7fcd74147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764890652 0 0) 0x7fcd740b3a00 con 0x7fcd74065c80 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd60003530 con 0x7fcd74065c80 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 740479751 0 0) 0x7fcd60003530 con 0x7fcd74065c80 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 >> v2:172.21.15.190:3300/0 conn(0x7fcd741473b0 msgr2=0x7fcd74147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 --2- 172.21.15.167:0/3257080005 >> v2:172.21.15.190:3300/0 conn(0x7fcd741473b0 0x7fcd74147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 >> v1:172.21.15.190:6789/0 conn(0x7fcd74066060 legacy=0x7fcd7413d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd740aff70 con 0x7fcd74065c80 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fcd64001680 con 0x7fcd74065c80 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 >> v1:172.21.15.167:6789/0 conn(0x7fcd74065c80 legacy=0x7fcd74143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd60003980 0x7fcd60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd600047d0 0x7fcd60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60005190 0x7fcd6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74144700 con 0x7fcd600047d0 2024-09-13T17:20:50.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6000c130 con 0x7fcd60005190 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6000c2f0 con 0x7fcd60003980 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd6bfff640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd600047d0 0x7fcd60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd737fe640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd60003980 0x7fcd60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd73fff640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60005190 0x7fcd6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd6bfff640 1 -- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd60003980 msgr2=0x7fcd60003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd6bfff640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd60003980 0x7fcd60003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd6bfff640 1 -- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60005190 msgr2=0x7fcd6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd6bfff640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60005190 0x7fcd6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd6bfff640 1 -- 172.21.15.167:0/3257080005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60003530 con 0x7fcd600047d0 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd73fff640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60005190 0x7fcd6000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.723+0000 7fcd73fff640 1 -- 172.21.15.167:0/3257080005 reap_dead start 2024-09-13T17:20:50.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd6bfff640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd600047d0 0x7fcd60004c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c001750 tx=0x7fcd5c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0a944382f026c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0052d0 con 0x7fcd600047d0 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c0a7050 con 0x7fcd600047d0 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd72ffd640 1 -- 172.21.15.167:0/3257080005 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c003600 con 0x7fcd600047d0 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- 172.21.15.167:0/3257080005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd600047d0 msgr2=0x7fcd60004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd600047d0 0x7fcd60004c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c001750 tx=0x7fcd5c01c390 comp rx=0 tx=0).stop 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- 172.21.15.167:0/3257080005 shutdown_connections 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 --2- 172.21.15.167:0/3257080005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd600047d0 0x7fcd60004c50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- 172.21.15.167:0/3257080005 >> 172.21.15.167:0/3257080005 conn(0x7fcd74069f80 msgr2=0x7fcd7406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- 172.21.15.167:0/3257080005 shutdown_connections 2024-09-13T17:20:50.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- 172.21.15.167:0/3257080005 wait complete. 2024-09-13T17:20:50.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 Processor -- start 2024-09-13T17:20:50.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- start start 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd600047d0 0x7fcd741dd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd740a7990 0x7fcd740b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd741dfcb0 0x7fcd741e0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740a7e50 con 0x7fcd740a7990 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd741dc740 con 0x7fcd600047d0 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd79f11640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740a8c80 con 0x7fcd741dfcb0 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd6bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd740a7990 0x7fcd740b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd6bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd740a7990 0x7fcd740b7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47240/0 (socket says 172.21.15.167:47240) 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd6bfff640 1 -- 172.21.15.167:0/1794271960 learned_addr learned my addr 172.21.15.167:0/1794271960 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:50.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.727+0000 7fcd73fff640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd741dfcb0 0x7fcd741e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd737fe640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd600047d0 0x7fcd741dd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd6bfff640 1 -- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd741dfcb0 msgr2=0x7fcd741e0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd6bfff640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd741dfcb0 0x7fcd741e0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd6bfff640 1 -- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd600047d0 msgr2=0x7fcd741dd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd6bfff640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd600047d0 0x7fcd741dd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd6bfff640 1 -- 172.21.15.167:0/1794271960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7413df20 con 0x7fcd740a7990 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd6bfff640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd740a7990 0x7fcd740b7d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c01c1c0 tx=0x7fcd60005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd70ff9640 1 -- 172.21.15.167:0/1794271960 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0072f0 con 0x7fcd740a7990 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd70ff9640 1 -- 172.21.15.167:0/1794271960 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c007450 con 0x7fcd740a7990 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd741dd690 con 0x7fcd740a7990 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd70ff9640 1 -- 172.21.15.167:0/1794271960 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0067e0 con 0x7fcd740a7990 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd741dcc30 con 0x7fcd740a7990 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7406af90 con 0x7fcd740a7990 2024-09-13T17:20:50.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd70ff9640 1 -- 172.21.15.167:0/1794271960 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd5c006940 con 0x7fcd740a7990 2024-09-13T17:20:50.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd70ff9640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcd540666c0 0x7fcd54068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:50.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd70ff9640 1 -- 172.21.15.167:0/1794271960 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcd5c11e530 con 0x7fcd740a7990 2024-09-13T17:20:50.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd737fe640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcd540666c0 0x7fcd54068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:50.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.731+0000 7fcd737fe640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcd540666c0 0x7fcd54068b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd64001060 tx=0x7fcd64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:50.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.735+0000 7fcd70ff9640 1 -- 172.21.15.167:0/1794271960 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd5c0eba70 con 0x7fcd740a7990 2024-09-13T17:20:50.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.919+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcd740b2b70 con 0x7fcd740a7990 2024-09-13T17:20:50.938 INFO:teuthology.orchestra.run.smithi167.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T17:20:50.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.935+0000 7fcd70ff9640 1 -- 172.21.15.167:0/1794271960 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcd5c0ef090 con 0x7fcd740a7990 2024-09-13T17:20:50.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.939+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcd540666c0 msgr2=0x7fcd54068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.939+0000 7fcd79f11640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcd540666c0 0x7fcd54068b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd64001060 tx=0x7fcd64009040 comp rx=0 tx=0).stop 2024-09-13T17:20:50.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.939+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd740a7990 msgr2=0x7fcd740b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:50.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.939+0000 7fcd79f11640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd740a7990 0x7fcd740b7d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c01c1c0 tx=0x7fcd60005800 comp rx=0 tx=0).stop 2024-09-13T17:20:50.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.943+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 shutdown_connections 2024-09-13T17:20:50.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.943+0000 7fcd79f11640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcd540666c0 0x7fcd54068b80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.943+0000 7fcd79f11640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd741dfcb0 0x7fcd741e0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.943+0000 7fcd79f11640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd740a7990 0x7fcd740b7d00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.943+0000 7fcd79f11640 1 --2- 172.21.15.167:0/1794271960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd600047d0 0x7fcd741dd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:50.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.943+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 >> 172.21.15.167:0/1794271960 conn(0x7fcd74069f80 msgr2=0x7fcd741416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:50.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.951+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 shutdown_connections 2024-09-13T17:20:50.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:50.951+0000 7fcd79f11640 1 -- 172.21.15.167:0/1794271960 wait complete. 2024-09-13T17:20:50.972 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T17:20:50.972 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T17:20:51.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f375dcac640 1 Processor -- start 2024-09-13T17:20:51.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f375dcac640 1 -- start start 2024-09-13T17:20:51.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f375dcac640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f37580ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:51.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f375dcac640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3758071d00 0x7f37580b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:51.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f375dcac640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37580ae000 con 0x7f37580b3620 2024-09-13T17:20:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f375dcac640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580b2c00 con 0x7f3758071d00 2024-09-13T17:20:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f375dcac640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3758145cb0 con 0x7f37580aca80 2024-09-13T17:20:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f3756ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3758071d00 0x7f37580b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f3757fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f37580b3620 0x7f375809cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44950/0 (socket says 172.21.15.167:44950) 2024-09-13T17:20:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f3757fff640 1 -- 172.21.15.167:0/815878404 learned_addr learned my addr 172.21.15.167:0/815878404 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f37567fc640 1 -- 172.21.15.167:0/815878404 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795307743 0 0) 0x7f37580ae000 con 0x7f37580b3620 2024-09-13T17:20:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f37577fe640 1 --2- 172.21.15.167:0/815878404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f37580ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f37567fc640 1 -- 172.21.15.167:0/815878404 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3744003530 con 0x7f37580b3620 2024-09-13T17:20:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f3756ffd640 1 -- 172.21.15.167:0/815878404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 msgr2=0x7f37580ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f3756ffd640 1 --2- 172.21.15.167:0/815878404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f37580ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f3756ffd640 1 -- 172.21.15.167:0/815878404 >> v1:172.21.15.167:6789/0 conn(0x7f37580b3620 legacy=0x7f375809cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.087+0000 7f3756ffd640 1 -- 172.21.15.167:0/815878404 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758099c60 con 0x7f3758071d00 2024-09-13T17:20:51.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f3756ffd640 1 --2- 172.21.15.167:0/815878404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3758071d00 0x7f37580b30e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37580ae190 tx=0x7f374001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54caf1fc5c7f8610 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:51.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f37567fc640 1 -- 172.21.15.167:0/815878404 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400a5970 con 0x7f3758071d00 2024-09-13T17:20:51.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f37567fc640 1 -- 172.21.15.167:0/815878404 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400a5ad0 con 0x7f3758071d00 2024-09-13T17:20:51.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f37567fc640 1 -- 172.21.15.167:0/815878404 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400a5e60 con 0x7f3758071d00 2024-09-13T17:20:51.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 -- 172.21.15.167:0/815878404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3758071d00 msgr2=0x7f37580b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:51.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 --2- 172.21.15.167:0/815878404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3758071d00 0x7f37580b30e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37580ae190 tx=0x7f374001c890 comp rx=0 tx=0).stop 2024-09-13T17:20:51.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 -- 172.21.15.167:0/815878404 shutdown_connections 2024-09-13T17:20:51.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 --2- 172.21.15.167:0/815878404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3758071d00 0x7f37580b30e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 --2- 172.21.15.167:0/815878404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f37580ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 -- 172.21.15.167:0/815878404 >> 172.21.15.167:0/815878404 conn(0x7f37580b3b50 msgr2=0x7f37580b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:51.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 -- 172.21.15.167:0/815878404 shutdown_connections 2024-09-13T17:20:51.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 -- 172.21.15.167:0/815878404 wait complete. 2024-09-13T17:20:51.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 Processor -- start 2024-09-13T17:20:51.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.091+0000 7f375dcac640 1 -- start start 2024-09-13T17:20:51.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f375814c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:51.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37580b3620 0x7f3758142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:51.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3758141220 0x7f37581416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:51.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758142550 con 0x7f37580b3620 2024-09-13T17:20:51.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37581407d0 con 0x7f3758141220 2024-09-13T17:20:51.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375813d1c0 con 0x7f37580aca80 2024-09-13T17:20:51.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37580b3620 0x7f3758142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:51.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37580b3620 0x7f3758142010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47272/0 (socket says 172.21.15.167:47272) 2024-09-13T17:20:51.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 -- 172.21.15.167:0/3461954951 learned_addr learned my addr 172.21.15.167:0/3461954951 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:51.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f37577fe640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f375814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:51.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 -- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 msgr2=0x7f375814c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:51.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f375814c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 -- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3758141220 msgr2=0x7f37581416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:51.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3758141220 0x7f37581416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 -- 172.21.15.167:0/3461954951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009a70 con 0x7f37580b3620 2024-09-13T17:20:51.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f37577fe640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f375814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:51.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f3756ffd640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37580b3620 0x7f3758142010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37400b0040 tx=0x7f3740019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:51.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f374ffff640 1 -- 172.21.15.167:0/3461954951 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400addf0 con 0x7f37580b3620 2024-09-13T17:20:51.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f374ffff640 1 -- 172.21.15.167:0/3461954951 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740009450 con 0x7f37580b3620 2024-09-13T17:20:51.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3758140a20 con 0x7f37580b3620 2024-09-13T17:20:51.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f374ffff640 1 -- 172.21.15.167:0/3461954951 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400b9690 con 0x7f37580b3620 2024-09-13T17:20:51.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3758141bf0 con 0x7f37580b3620 2024-09-13T17:20:51.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37580b30e0 con 0x7f37580b3620 2024-09-13T17:20:51.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f374ffff640 1 -- 172.21.15.167:0/3461954951 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f37400b97f0 con 0x7f37580b3620 2024-09-13T17:20:51.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f374ffff640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3738066690 0x7f3738068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:51.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f37577fe640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3738066690 0x7f3738068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:51.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f374ffff640 1 -- 172.21.15.167:0/3461954951 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f374011f980 con 0x7f37580b3620 2024-09-13T17:20:51.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.095+0000 7f37577fe640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3738066690 0x7f3738068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3750009840 tx=0x7f3750008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:51.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.099+0000 7f374ffff640 1 -- 172.21.15.167:0/3461954951 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f37400ecf60 con 0x7f37580b3620 2024-09-13T17:20:51.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.271+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3758074200 con 0x7f37580b3620 2024-09-13T17:20:51.365 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:51.368 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:51.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.943+0000 7f374ffff640 1 -- 172.21.15.167:0/3461954951 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f37400f0580 con 0x7f37580b3620 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3738066690 msgr2=0x7f3738068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3738066690 0x7f3738068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3750009840 tx=0x7f3750008040 comp rx=0 tx=0).stop 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37580b3620 msgr2=0x7f3758142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37580b3620 0x7f3758142010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37400b0040 tx=0x7f3740019630 comp rx=0 tx=0).stop 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 shutdown_connections 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3738066690 0x7f3738068b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3758141220 0x7f37581416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37580b3620 0x7f3758142010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 --2- 172.21.15.167:0/3461954951 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37580aca80 0x7f375814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:51.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 >> 172.21.15.167:0/3461954951 conn(0x7f37580b3b50 msgr2=0x7f3758098a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:51.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 shutdown_connections 2024-09-13T17:20:51.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:51.947+0000 7f375dcac640 1 -- 172.21.15.167:0/3461954951 wait complete. 2024-09-13T17:20:51.966 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:20:52.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.099+0000 7f8b2f69c640 1 Processor -- start 2024-09-13T17:20:52.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2f69c640 1 -- start start 2024-09-13T17:20:52.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2f69c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b280992d0 0x7f8b280ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:52.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2f69c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b28142d70 0x7f8b2814c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:52.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2f69c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280ae2a0 con 0x7f8b280996b0 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2f69c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b280b34c0 con 0x7f8b28142d70 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2f69c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280ad4e0 con 0x7f8b280992d0 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b28142d70 0x7f8b2814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b28142d70 0x7f8b2814c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47288/0 (socket says 172.21.15.167:47288) 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 -- 172.21.15.167:0/209099758 learned_addr learned my addr 172.21.15.167:0/209099758 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 -- 172.21.15.167:0/209099758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b280992d0 msgr2=0x7f8b280ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2d438640 1 --2- 172.21.15.167:0/209099758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b280992d0 0x7f8b280ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 --2- 172.21.15.167:0/209099758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b280992d0 0x7f8b280ac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b1ffff640 1 -- 172.21.15.167:0/209099758 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984863211 0 0) 0x7f8b280ae2a0 con 0x7f8b280996b0 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 -- 172.21.15.167:0/209099758 >> v1:172.21.15.167:6789/0 conn(0x7f8b280996b0 legacy=0x7f8b28142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 -- 172.21.15.167:0/209099758 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b280ad7c0 con 0x7f8b28142d70 2024-09-13T17:20:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.103+0000 7f8b2dc39640 1 --2- 172.21.15.167:0/209099758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b28142d70 0x7f8b2814c930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009e50 tx=0x7f8b2001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be38c9470b6c957b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b1ffff640 1 -- 172.21.15.167:0/209099758 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200a5830 con 0x7f8b28142d70 2024-09-13T17:20:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b1ffff640 1 -- 172.21.15.167:0/209099758 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b200a5990 con 0x7f8b28142d70 2024-09-13T17:20:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b1ffff640 1 -- 172.21.15.167:0/209099758 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200a5d20 con 0x7f8b28142d70 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- 172.21.15.167:0/209099758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b28142d70 msgr2=0x7f8b2814c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/209099758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b28142d70 0x7f8b2814c930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009e50 tx=0x7f8b2001c970 comp rx=0 tx=0).stop 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- 172.21.15.167:0/209099758 shutdown_connections 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/209099758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b28142d70 0x7f8b2814c930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/209099758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b280992d0 0x7f8b280ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- 172.21.15.167:0/209099758 >> 172.21.15.167:0/209099758 conn(0x7f8b280b3b50 msgr2=0x7f8b280b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- 172.21.15.167:0/209099758 shutdown_connections 2024-09-13T17:20:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- 172.21.15.167:0/209099758 wait complete. 2024-09-13T17:20:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 Processor -- start 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- start start 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b280992d0 0x7f8b2809be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b280996b0 0x7f8b280afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b28142d70 0x7f8b280b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280b05a0 con 0x7f8b280996b0 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2809a660 con 0x7f8b280992d0 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2813c170 con 0x7f8b28142d70 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b280996b0 0x7f8b280afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b280996b0 0x7f8b280afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47294/0 (socket says 172.21.15.167:47294) 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 -- 172.21.15.167:0/2331181032 learned_addr learned my addr 172.21.15.167:0/2331181032 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2dc39640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b28142d70 0x7f8b280b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2d438640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b280992d0 0x7f8b2809be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 -- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b28142d70 msgr2=0x7f8b280b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b28142d70 0x7f8b280b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 -- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b280992d0 msgr2=0x7f8b2809be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b280992d0 0x7f8b2809be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 -- 172.21.15.167:0/2331181032 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009b30 con 0x7f8b280996b0 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2dc39640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b28142d70 0x7f8b280b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2cc37640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b280996b0 0x7f8b280afb20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c520 tx=0x7f8b1800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b1dffb640 1 -- 172.21.15.167:0/2331181032 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18003600 con 0x7f8b280996b0 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b1dffb640 1 -- 172.21.15.167:0/2331181032 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18003780 con 0x7f8b280996b0 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b1dffb640 1 -- 172.21.15.167:0/2331181032 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18003b30 con 0x7f8b280996b0 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2809b3a0 con 0x7f8b280996b0 2024-09-13T17:20:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.107+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2809a380 con 0x7f8b280996b0 2024-09-13T17:20:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.111+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b280ad070 con 0x7f8b280996b0 2024-09-13T17:20:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.111+0000 7f8b1dffb640 1 -- 172.21.15.167:0/2331181032 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b18003c90 con 0x7f8b280996b0 2024-09-13T17:20:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.111+0000 7f8b1dffb640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8b0c066690 0x7f8b0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.111+0000 7f8b1dffb640 1 -- 172.21.15.167:0/2331181032 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8b18083820 con 0x7f8b280996b0 2024-09-13T17:20:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.111+0000 7f8b2d438640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8b0c066690 0x7f8b0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:52.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.111+0000 7f8b2d438640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8b0c066690 0x7f8b0c068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b2813efb0 tx=0x7f8b24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:52.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.115+0000 7f8b1dffb640 1 -- 172.21.15.167:0/2331181032 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b18050b40 con 0x7f8b280996b0 2024-09-13T17:20:52.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:52.263+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8b28071e10 con 0x7f8b280996b0 2024-09-13T17:20:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.955+0000 7f8b1dffb640 1 -- 172.21.15.167:0/2331181032 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f8b18054160 con 0x7f8b280996b0 2024-09-13T17:20:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data_ec' created 2024-09-13T17:20:53.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.959+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8b0c066690 msgr2=0x7f8b0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:53.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.959+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8b0c066690 0x7f8b0c068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b2813efb0 tx=0x7f8b24008040 comp rx=0 tx=0).stop 2024-09-13T17:20:53.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.959+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b280996b0 msgr2=0x7f8b280afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:53.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.959+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b280996b0 0x7f8b280afb20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c520 tx=0x7f8b1800c9e0 comp rx=0 tx=0).stop 2024-09-13T17:20:53.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.963+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 shutdown_connections 2024-09-13T17:20:53.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.963+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8b0c066690 0x7f8b0c068b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:53.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.963+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b28142d70 0x7f8b280b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:53.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.963+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b280996b0 0x7f8b280afb20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:53.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.963+0000 7f8b2f69c640 1 --2- 172.21.15.167:0/2331181032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b280992d0 0x7f8b2809be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:53.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.963+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 >> 172.21.15.167:0/2331181032 conn(0x7f8b280b3b50 msgr2=0x7f8b281412b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:53.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.963+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 shutdown_connections 2024-09-13T17:20:53.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:53.967+0000 7f8b2f69c640 1 -- 172.21.15.167:0/2331181032 wait complete. 2024-09-13T17:20:53.989 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T17:20:54.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e5617d640 1 Processor -- start 2024-09-13T17:20:54.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e5617d640 1 -- start start 2024-09-13T17:20:54.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e5617d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6e5009a650 0x7f6e50145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e5617d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 0x7f6e50150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e5617d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5006a3a0 con 0x7f6e500bada0 2024-09-13T17:20:54.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e5617d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e500b6c40 con 0x7f6e5009a650 2024-09-13T17:20:54.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e5617d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50145fd0 con 0x7f6e5006a830 2024-09-13T17:20:54.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6e500bada0 0x7f6e50099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44964/0 (socket says 172.21.15.167:44964) 2024-09-13T17:20:54.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4f7fe640 1 -- 172.21.15.167:0/3620994733 learned_addr learned my addr 172.21.15.167:0/3620994733 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:54.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4effd640 1 --2- 172.21.15.167:0/3620994733 >> v2:172.21.15.190:3300/0 conn(0x7f6e5009a650 0x7f6e50145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4ffff640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 0x7f6e50150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764610607 0 0) 0x7f6e5006a3a0 con 0x7f6e500bada0 2024-09-13T17:20:54.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e38003530 con 0x7f6e500bada0 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710612001 0 0) 0x7f6e38003530 con 0x7f6e500bada0 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 msgr2=0x7f6e50150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 0x7f6e50150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 >> v2:172.21.15.190:3300/0 conn(0x7f6e5009a650 msgr2=0x7f6e50145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 --2- 172.21.15.167:0/3620994733 >> v2:172.21.15.190:3300/0 conn(0x7f6e5009a650 0x7f6e50145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500bb180 con 0x7f6e500bada0 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f6e44001680 con 0x7f6e500bada0 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4effd640 1 --2- 172.21.15.167:0/3620994733 >> v2:172.21.15.190:3300/0 conn(0x7f6e5009a650 0x7f6e50145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 >> v1:172.21.15.167:6789/0 conn(0x7f6e500bada0 legacy=0x7f6e50099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e38003980 0x7f6e38003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 0x7f6e380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e38004d10 0x7f6e38005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50145fd0 con 0x7f6e38004d10 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3800b9f0 con 0x7f6e38003980 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3800bbb0 con 0x7f6e5006a830 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4ffff640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e38004d10 0x7f6e38005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4f7fe640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e38003980 0x7f6e38003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4effd640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 0x7f6e380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4ffff640 1 -- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 msgr2=0x7f6e380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4ffff640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 0x7f6e380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4ffff640 1 -- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e38003980 msgr2=0x7f6e38003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4ffff640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e38003980 0x7f6e38003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4ffff640 1 -- 172.21.15.167:0/3620994733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38003530 con 0x7f6e38004d10 2024-09-13T17:20:54.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.111+0000 7f6e4effd640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5006a830 0x7f6e380047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e4ffff640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e38004d10 0x7f6e38005190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009f90 tx=0x7f6e4801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e282d0d7eab25f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480a5b40 con 0x7f6e38004d10 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800f040 con 0x7f6e38004d10 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e4e7fc640 1 -- 172.21.15.167:0/3620994733 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480ad440 con 0x7f6e38004d10 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 -- 172.21.15.167:0/3620994733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e38004d10 msgr2=0x7f6e38005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 --2- 172.21.15.167:0/3620994733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e38004d10 0x7f6e38005190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009f90 tx=0x7f6e4801cc40 comp rx=0 tx=0).stop 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e4ffff640 1 -- 172.21.15.167:0/3620994733 reap_dead start 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 -- 172.21.15.167:0/3620994733 shutdown_connections 2024-09-13T17:20:54.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 -- 172.21.15.167:0/3620994733 >> 172.21.15.167:0/3620994733 conn(0x7f6e500b7e40 msgr2=0x7f6e500b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:54.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 -- 172.21.15.167:0/3620994733 shutdown_connections 2024-09-13T17:20:54.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 -- 172.21.15.167:0/3620994733 wait complete. 2024-09-13T17:20:54.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 Processor -- start 2024-09-13T17:20:54.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.115+0000 7f6e5617d640 1 -- start start 2024-09-13T17:20:54.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e501dec70 0x7f6e500b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e500b1000 0x7f6e5013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5013e6f0 0x7f6e501db4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5013f180 con 0x7f6e500b1000 2024-09-13T17:20:54.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501df480 con 0x7f6e501dec70 2024-09-13T17:20:54.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501df910 con 0x7f6e5013e6f0 2024-09-13T17:20:54.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e500b1000 0x7f6e5013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e500b1000 0x7f6e5013e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47308/0 (socket says 172.21.15.167:47308) 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 -- 172.21.15.167:0/3496462760 learned_addr learned my addr 172.21.15.167:0/3496462760 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4f7fe640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e501dec70 0x7f6e500b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4ffff640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5013e6f0 0x7f6e501db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 -- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5013e6f0 msgr2=0x7f6e501db4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5013e6f0 0x7f6e501db4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 -- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e501dec70 msgr2=0x7f6e500b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e501dec70 0x7f6e500b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 -- 172.21.15.167:0/3496462760 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500b23d0 con 0x7f6e500b1000 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4f7fe640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e501dec70 0x7f6e500b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4effd640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e500b1000 0x7f6e5013e1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000f680 tx=0x7f6e4000fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e37fff640 1 -- 172.21.15.167:0/3496462760 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000d940 con 0x7f6e500b1000 2024-09-13T17:20:54.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e37fff640 1 -- 172.21.15.167:0/3496462760 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4000c030 con 0x7f6e500b1000 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e500b26b0 con 0x7f6e500b1000 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e37fff640 1 -- 172.21.15.167:0/3496462760 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000dca0 con 0x7f6e500b1000 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e501df050 con 0x7f6e500b1000 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e500b28f0 con 0x7f6e500b1000 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e37fff640 1 -- 172.21.15.167:0/3496462760 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e40014480 con 0x7f6e500b1000 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e37fff640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e3c0666c0 0x7f6e3c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e37fff640 1 -- 172.21.15.167:0/3496462760 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6e40084810 con 0x7f6e500b1000 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.119+0000 7f6e4f7fe640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e3c0666c0 0x7f6e3c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:54.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.123+0000 7f6e4f7fe640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e3c0666c0 0x7f6e3c068b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000c10 tx=0x7f6e44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:54.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.127+0000 7f6e37fff640 1 -- 172.21.15.167:0/3496462760 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e500b28f0 con 0x7f6e500b1000 2024-09-13T17:20:54.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.283+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f6e500b28f0 con 0x7f6e500b1000 2024-09-13T17:20:54.902 INFO:tasks.ceph.mds.a.smithi167.stderr:2024-09-13T17:20:54.899+0000 7fc611ef3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:20:54.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.959+0000 7f6e37fff640 1 -- 172.21.15.167:0/3496462760 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6e500b28f0 con 0x7f6e500b1000 2024-09-13T17:20:54.963 INFO:teuthology.orchestra.run.smithi167.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T17:20:54.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e3c0666c0 msgr2=0x7f6e3c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:54.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e3c0666c0 0x7f6e3c068b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000c10 tx=0x7f6e44009040 comp rx=0 tx=0).stop 2024-09-13T17:20:54.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e500b1000 msgr2=0x7f6e5013e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:54.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e500b1000 0x7f6e5013e1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000f680 tx=0x7f6e4000fb40 comp rx=0 tx=0).stop 2024-09-13T17:20:54.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 shutdown_connections 2024-09-13T17:20:54.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e3c0666c0 0x7f6e3c068b80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5013e6f0 0x7f6e501db4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e500b1000 0x7f6e5013e1b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 --2- 172.21.15.167:0/3496462760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e501dec70 0x7f6e500b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:54.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 >> 172.21.15.167:0/3496462760 conn(0x7f6e500b7e40 msgr2=0x7f6e50065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:54.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 shutdown_connections 2024-09-13T17:20:54.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:54.971+0000 7f6e5617d640 1 -- 172.21.15.167:0/3496462760 wait complete. 2024-09-13T17:20:55.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T17:20:55.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.131+0000 7fca715b7640 1 Processor -- start 2024-09-13T17:20:55.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.131+0000 7fca715b7640 1 -- start start 2024-09-13T17:20:55.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.131+0000 7fca715b7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fca6c0bada0 0x7fca6c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c06a3a0 con 0x7fca6c09a650 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c145fd0 con 0x7fca6c06a830 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c0b6c40 con 0x7fca6c0bada0 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fca6c0bada0 0x7fca6c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fca6c09a650 0x7fca6c150380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44966/0 (socket says 172.21.15.167:44966) 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6b7fe640 1 -- 172.21.15.167:0/949311787 learned_addr learned my addr 172.21.15.167:0/949311787 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6a7fc640 1 -- 172.21.15.167:0/949311787 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625738981 0 0) 0x7fca6c06a3a0 con 0x7fca6c09a650 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6a7fc640 1 -- 172.21.15.167:0/949311787 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca58003530 con 0x7fca6c09a650 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6affd640 1 -- 172.21.15.167:0/949311787 >> v1:172.21.15.190:6789/0 conn(0x7fca6c06a830 legacy=0x7fca6c099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6affd640 1 -- 172.21.15.167:0/949311787 >> v1:172.21.15.167:6789/0 conn(0x7fca6c09a650 legacy=0x7fca6c150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6affd640 1 -- 172.21.15.167:0/949311787 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c0bb180 con 0x7fca6c0bada0 2024-09-13T17:20:55.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6affd640 1 --2- 172.21.15.167:0/949311787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0bada0 0x7fca6c145a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0097c0 tx=0x7fca5c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301892c07a33a1c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6a7fc640 1 -- 172.21.15.167:0/949311787 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0ab5f0 con 0x7fca6c0bada0 2024-09-13T17:20:55.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6a7fc640 1 -- 172.21.15.167:0/949311787 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c0ab750 con 0x7fca6c0bada0 2024-09-13T17:20:55.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca6a7fc640 1 -- 172.21.15.167:0/949311787 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0abac0 con 0x7fca6c0bada0 2024-09-13T17:20:55.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- 172.21.15.167:0/949311787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0bada0 msgr2=0x7fca6c145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 --2- 172.21.15.167:0/949311787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0bada0 0x7fca6c145a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0097c0 tx=0x7fca5c01c3d0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- 172.21.15.167:0/949311787 shutdown_connections 2024-09-13T17:20:55.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 --2- 172.21.15.167:0/949311787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0bada0 0x7fca6c145a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- 172.21.15.167:0/949311787 >> 172.21.15.167:0/949311787 conn(0x7fca6c0b7e40 msgr2=0x7fca6c0b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:55.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- 172.21.15.167:0/949311787 shutdown_connections 2024-09-13T17:20:55.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.135+0000 7fca715b7640 1 -- 172.21.15.167:0/949311787 wait complete. 2024-09-13T17:20:55.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 Processor -- start 2024-09-13T17:20:55.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 -- start start 2024-09-13T17:20:55.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca6c06a830 0x7fca6c0a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca6c0bada0 0x7fca6c142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c1426b0 0x7fca6c1389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c142e50 con 0x7fca6c1426b0 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c142b60 con 0x7fca6c06a830 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0b1560 con 0x7fca6c0bada0 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c1426b0 0x7fca6c1389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c1426b0 0x7fca6c1389f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47340/0 (socket says 172.21.15.167:47340) 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 -- 172.21.15.167:0/566724058 learned_addr learned my addr 172.21.15.167:0/566724058 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca63fff640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca6c0bada0 0x7fca6c142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6affd640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca6c06a830 0x7fca6c0a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 -- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca6c0bada0 msgr2=0x7fca6c142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca6c0bada0 0x7fca6c142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 -- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca6c06a830 msgr2=0x7fca6c0a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca6c06a830 0x7fca6c0a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 -- 172.21.15.167:0/566724058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009420 con 0x7fca6c1426b0 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca63fff640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca6c0bada0 0x7fca6c142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca6b7fe640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c1426b0 0x7fca6c1389f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca6400caa0 tx=0x7fca6400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca637fe640 1 -- 172.21.15.167:0/566724058 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400ac00 con 0x7fca6c1426b0 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca637fe640 1 -- 172.21.15.167:0/566724058 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400ad60 con 0x7fca6c1426b0 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c0b1840 con 0x7fca6c1426b0 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca637fe640 1 -- 172.21.15.167:0/566724058 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64012600 con 0x7fca6c1426b0 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c143380 con 0x7fca6c1426b0 2024-09-13T17:20:55.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.139+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c145a90 con 0x7fca6c1426b0 2024-09-13T17:20:55.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.143+0000 7fca637fe640 1 -- 172.21.15.167:0/566724058 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca64007070 con 0x7fca6c1426b0 2024-09-13T17:20:55.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.143+0000 7fca637fe640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fca4c0666c0 0x7fca4c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.143+0000 7fca637fe640 1 -- 172.21.15.167:0/566724058 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fca640841e0 con 0x7fca6c1426b0 2024-09-13T17:20:55.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.143+0000 7fca6affd640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fca4c0666c0 0x7fca4c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.143+0000 7fca6affd640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fca4c0666c0 0x7fca4c068b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0af000 tx=0x7fca5c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.147+0000 7fca637fe640 1 -- 172.21.15.167:0/566724058 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca640513c0 con 0x7fca6c1426b0 2024-09-13T17:20:55.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.347+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fca6c145620 con 0x7fca6c1426b0 2024-09-13T17:20:55.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca637fe640 1 -- 172.21.15.167:0/566724058 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fca640549e0 con 0x7fca6c1426b0 2024-09-13T17:20:55.356 INFO:teuthology.orchestra.run.smithi167.stderr:added data pool 4 to fsmap 2024-09-13T17:20:55.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fca4c0666c0 msgr2=0x7fca4c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fca4c0666c0 0x7fca4c068b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0af000 tx=0x7fca5c0a7000 comp rx=0 tx=0).stop 2024-09-13T17:20:55.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c1426b0 msgr2=0x7fca6c1389f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c1426b0 0x7fca6c1389f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca6400caa0 tx=0x7fca6400cf60 comp rx=0 tx=0).stop 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 shutdown_connections 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fca4c0666c0 0x7fca4c068b80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c1426b0 0x7fca6c1389f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca6c0bada0 0x7fca6c142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 --2- 172.21.15.167:0/566724058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca6c06a830 0x7fca6c0a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 >> 172.21.15.167:0/566724058 conn(0x7fca6c0b7e40 msgr2=0x7fca6c065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 shutdown_connections 2024-09-13T17:20:55.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.355+0000 7fca715b7640 1 -- 172.21.15.167:0/566724058 wait complete. 2024-09-13T17:20:55.376 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:20:55.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.487+0000 7f6ebb2a2640 1 Processor -- start 2024-09-13T17:20:55.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.487+0000 7f6ebb2a2640 1 -- start start 2024-09-13T17:20:55.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6eb406f0f0 0x7f6eb40b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6eb4070ff0 0x7f6eb414e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb4071b10 con 0x7f6eb4070bb0 2024-09-13T17:20:55.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb406f7f0 con 0x7f6eb406f0f0 2024-09-13T17:20:55.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40b0ea0 con 0x7f6eb4070ff0 2024-09-13T17:20:55.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb903e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6eb406f0f0 0x7f6eb40b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb883d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6eb4070bb0 0x7f6eb413d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44974/0 (socket says 172.21.15.167:44974) 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb883d640 1 -- 172.21.15.167:0/2012795512 learned_addr learned my addr 172.21.15.167:0/2012795512 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb903e640 1 -- 172.21.15.167:0/2012795512 >> v2:172.21.15.190:3300/0 conn(0x7f6eb4070ff0 msgr2=0x7f6eb414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb983f640 1 --2- 172.21.15.167:0/2012795512 >> v2:172.21.15.190:3300/0 conn(0x7f6eb4070ff0 0x7f6eb414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb3fff640 1 -- 172.21.15.167:0/2012795512 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477423954 0 0) 0x7f6eb4071b10 con 0x7f6eb4070bb0 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb903e640 1 --2- 172.21.15.167:0/2012795512 >> v2:172.21.15.190:3300/0 conn(0x7f6eb4070ff0 0x7f6eb414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb903e640 1 -- 172.21.15.167:0/2012795512 >> v1:172.21.15.167:6789/0 conn(0x7f6eb4070bb0 legacy=0x7f6eb413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb903e640 1 -- 172.21.15.167:0/2012795512 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4071df0 con 0x7f6eb406f0f0 2024-09-13T17:20:55.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb983f640 1 --2- 172.21.15.167:0/2012795512 >> v2:172.21.15.190:3300/0 conn(0x7f6eb4070ff0 0x7f6eb414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:55.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb903e640 1 --2- 172.21.15.167:0/2012795512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb40b0960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6eb406bca0 tx=0x7f6eac01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e23dac04f8418c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb3fff640 1 -- 172.21.15.167:0/2012795512 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0ab600 con 0x7f6eb406f0f0 2024-09-13T17:20:55.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb3fff640 1 -- 172.21.15.167:0/2012795512 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0a7050 con 0x7f6eb406f0f0 2024-09-13T17:20:55.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6eb3fff640 1 -- 172.21.15.167:0/2012795512 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0ab980 con 0x7f6eb406f0f0 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/2012795512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 msgr2=0x7f6eb40b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/2012795512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb40b0960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6eb406bca0 tx=0x7f6eac01c340 comp rx=0 tx=0).stop 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/2012795512 shutdown_connections 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/2012795512 >> v2:172.21.15.190:3300/0 conn(0x7f6eb4070ff0 0x7f6eb414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/2012795512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb40b0960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.491+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/2012795512 >> 172.21.15.167:0/2012795512 conn(0x7f6eb40b7250 msgr2=0x7f6eb40b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/2012795512 shutdown_connections 2024-09-13T17:20:55.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/2012795512 wait complete. 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 Processor -- start 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- start start 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb4144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb4070bb0 0x7f6eb4148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eb4070ff0 0x7f6eb4136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4149830 con 0x7f6eb406f0f0 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41473d0 con 0x7f6eb4070bb0 2024-09-13T17:20:55.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41476b0 con 0x7f6eb4070ff0 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb4144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb4144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47360/0 (socket says 172.21.15.167:47360) 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 -- 172.21.15.167:0/3964826527 learned_addr learned my addr 172.21.15.167:0/3964826527 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb883d640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb4070bb0 0x7f6eb4148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 -- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eb4070ff0 msgr2=0x7f6eb4136fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb983f640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eb4070ff0 0x7f6eb4136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eb4070ff0 0x7f6eb4136fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 -- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb4070bb0 msgr2=0x7f6eb4148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb4070bb0 0x7f6eb4148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 -- 172.21.15.167:0/3964826527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009420 con 0x7f6eb406f0f0 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb883d640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb4070bb0 0x7f6eb4148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb903e640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb4144a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6eac018f50 tx=0x7f6eac0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb1ffb640 1 -- 172.21.15.167:0/3964826527 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0b4810 con 0x7f6eb406f0f0 2024-09-13T17:20:55.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb1ffb640 1 -- 172.21.15.167:0/3964826527 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0b49b0 con 0x7f6eb406f0f0 2024-09-13T17:20:55.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4072400 con 0x7f6eb406f0f0 2024-09-13T17:20:55.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6eb1ffb640 1 -- 172.21.15.167:0/3964826527 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0b4d60 con 0x7f6eb406f0f0 2024-09-13T17:20:55.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb41470c0 con 0x7f6eb406f0f0 2024-09-13T17:20:55.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.495+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb41478d0 con 0x7f6eb406f0f0 2024-09-13T17:20:55.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.499+0000 7f6eb1ffb640 1 -- 172.21.15.167:0/3964826527 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6eac0b2040 con 0x7f6eb406f0f0 2024-09-13T17:20:55.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.499+0000 7f6eb1ffb640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6ea0066690 0x7f6ea0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.499+0000 7f6eb1ffb640 1 -- 172.21.15.167:0/3964826527 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6eac11eb90 con 0x7f6eb406f0f0 2024-09-13T17:20:55.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.499+0000 7f6eb883d640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6ea0066690 0x7f6ea0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.499+0000 7f6eb883d640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6ea0066690 0x7f6ea0068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8007fd0 tx=0x7f6ea8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.503+0000 7f6eb1ffb640 1 -- 172.21.15.167:0/3964826527 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6eac0ebcf0 con 0x7f6eb406f0f0 2024-09-13T17:20:55.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.695+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eb40b0960 con 0x7f6eb406f0f0 2024-09-13T17:20:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.695+0000 7f6eb1ffb640 1 -- 172.21.15.167:0/3964826527 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3221 (secure 0 0 0) 0x7f6eac0b0cb0 con 0x7f6eb406f0f0 2024-09-13T17:20:55.697 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:55.697 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:20:55.351907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:20:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 6 2024-09-13T17:20:55.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6ea0066690 msgr2=0x7f6ea0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6ea0066690 0x7f6ea0068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8007fd0 tx=0x7f6ea8009040 comp rx=0 tx=0).stop 2024-09-13T17:20:55.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 msgr2=0x7f6eb4144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb4144a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6eac018f50 tx=0x7f6eac0190e0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 shutdown_connections 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6ea0066690 0x7f6ea0068b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eb4070ff0 0x7f6eb4136fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb4070bb0 0x7f6eb4148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 --2- 172.21.15.167:0/3964826527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb406f0f0 0x7f6eb4144a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 >> 172.21.15.167:0/3964826527 conn(0x7f6eb40b7250 msgr2=0x7f6eb40b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 shutdown_connections 2024-09-13T17:20:55.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.699+0000 7f6ebb2a2640 1 -- 172.21.15.167:0/3964826527 wait complete. 2024-09-13T17:20:55.716 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:55.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.835+0000 7f9a45311640 1 Processor -- start 2024-09-13T17:20:55.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.835+0000 7f9a45311640 1 -- start start 2024-09-13T17:20:55.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.835+0000 7f9a45311640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a400b0da0 0x7f9a400b1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b30e0 0x7f9a400b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a400ae290 con 0x7f9a400b2cd0 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a400b1780 con 0x7f9a400b0da0 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400aee30 con 0x7f9a400b30e0 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a400b0da0 0x7f9a400b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a400b0da0 0x7f9a400b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47372/0 (socket says 172.21.15.167:47372) 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 -- 172.21.15.167:0/2676676437 learned_addr learned my addr 172.21.15.167:0/2676676437 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 -- 172.21.15.167:0/2676676437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b30e0 msgr2=0x7f9a400b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3f7fe640 1 --2- 172.21.15.167:0/2676676437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b30e0 0x7f9a400b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 --2- 172.21.15.167:0/2676676437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b30e0 0x7f9a400b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 -- 172.21.15.167:0/2676676437 >> v1:172.21.15.190:6789/0 conn(0x7f9a400b2cd0 legacy=0x7f9a400b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:55.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 -- 172.21.15.167:0/2676676437 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400ae9a0 con 0x7f9a400b0da0 2024-09-13T17:20:55.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3effd640 1 --2- 172.21.15.167:0/2676676437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b0da0 0x7f9a400b1180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009870 tx=0x7f9a3801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54675b6349dd583 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3dffb640 1 -- 172.21.15.167:0/2676676437 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380ad640 con 0x7f9a400b0da0 2024-09-13T17:20:55.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3dffb640 1 -- 172.21.15.167:0/2676676437 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380ad7a0 con 0x7f9a400b0da0 2024-09-13T17:20:55.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a3dffb640 1 -- 172.21.15.167:0/2676676437 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380adb30 con 0x7f9a400b0da0 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- 172.21.15.167:0/2676676437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b0da0 msgr2=0x7f9a400b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 --2- 172.21.15.167:0/2676676437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b0da0 0x7f9a400b1180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009870 tx=0x7f9a3801c3d0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- 172.21.15.167:0/2676676437 shutdown_connections 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 --2- 172.21.15.167:0/2676676437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b30e0 0x7f9a400b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 --2- 172.21.15.167:0/2676676437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b0da0 0x7f9a400b1180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- 172.21.15.167:0/2676676437 >> 172.21.15.167:0/2676676437 conn(0x7f9a400b7250 msgr2=0x7f9a400b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- 172.21.15.167:0/2676676437 shutdown_connections 2024-09-13T17:20:55.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.839+0000 7f9a45311640 1 -- 172.21.15.167:0/2676676437 wait complete. 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 Processor -- start 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 -- start start 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b0da0 0x7f9a40142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a400b2cd0 0x7f9a401de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b30e0 0x7f9a401debc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40071b20 con 0x7f9a400b30e0 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a401439a0 con 0x7f9a400b2cd0 2024-09-13T17:20:55.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40143630 con 0x7f9a400b0da0 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b30e0 0x7f9a401debc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b30e0 0x7f9a401debc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47384/0 (socket says 172.21.15.167:47384) 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 -- 172.21.15.167:0/3272710744 learned_addr learned my addr 172.21.15.167:0/3272710744 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3e7fc640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a400b2cd0 0x7f9a401de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3effd640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b0da0 0x7f9a40142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 -- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b0da0 msgr2=0x7f9a40142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b0da0 0x7f9a40142900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 -- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a400b2cd0 msgr2=0x7f9a401de680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a400b2cd0 0x7f9a401de680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 -- 172.21.15.167:0/3272710744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380094d0 con 0x7f9a400b30e0 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a3f7fe640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b30e0 0x7f9a401debc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c820 tx=0x7f9a3000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a377fe640 1 -- 172.21.15.167:0/3272710744 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30004220 con 0x7f9a400b30e0 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a377fe640 1 -- 172.21.15.167:0/3272710744 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a30004380 con 0x7f9a400b30e0 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a401448f0 con 0x7f9a400b30e0 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a377fe640 1 -- 172.21.15.167:0/3272710744 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30007a50 con 0x7f9a400b30e0 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a40071780 con 0x7f9a400b30e0 2024-09-13T17:20:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40143490 con 0x7f9a400b30e0 2024-09-13T17:20:55.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.843+0000 7f9a377fe640 1 -- 172.21.15.167:0/3272710744 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a30007bb0 con 0x7f9a400b30e0 2024-09-13T17:20:55.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.847+0000 7f9a377fe640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a20066690 0x7f9a20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:55.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.847+0000 7f9a3effd640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a20066690 0x7f9a20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:55.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.847+0000 7f9a377fe640 1 -- 172.21.15.167:0/3272710744 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a30084210 con 0x7f9a400b30e0 2024-09-13T17:20:55.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.847+0000 7f9a3effd640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a20066690 0x7f9a20068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a380af000 tx=0x7f9a38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:55.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:55.851+0000 7f9a377fe640 1 -- 172.21.15.167:0/3272710744 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a40143490 con 0x7f9a400b30e0 2024-09-13T17:20:56.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.007+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a40143ae0 con 0x7f9a400b30e0 2024-09-13T17:20:56.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.007+0000 7f9a377fe640 1 -- 172.21.15.167:0/3272710744 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f9a40143ae0 con 0x7f9a400b30e0 2024-09-13T17:20:56.011 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:56.011 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:56.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a20066690 msgr2=0x7f9a20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a20066690 0x7f9a20068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a380af000 tx=0x7f9a38008040 comp rx=0 tx=0).stop 2024-09-13T17:20:56.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b30e0 msgr2=0x7f9a401debc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b30e0 0x7f9a401debc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c820 tx=0x7f9a3000cce0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 shutdown_connections 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9a20066690 0x7f9a20068b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a400b30e0 0x7f9a401debc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a400b2cd0 0x7f9a401de680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 --2- 172.21.15.167:0/3272710744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a400b0da0 0x7f9a40142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 >> 172.21.15.167:0/3272710744 conn(0x7f9a400b7250 msgr2=0x7f9a40146ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 shutdown_connections 2024-09-13T17:20:56.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.011+0000 7f9a45311640 1 -- 172.21.15.167:0/3272710744 wait complete. 2024-09-13T17:20:56.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:56.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.139+0000 7f353b3c0640 1 Processor -- start 2024-09-13T17:20:56.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.139+0000 7f353b3c0640 1 -- start start 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f353406f0f0 0x7f35340b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 0x7f353414e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3534071b10 con 0x7f3534070bb0 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353406f7f0 con 0x7f353406f0f0 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340b0ea0 con 0x7f3534070ff0 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f353406f0f0 0x7f35340b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f353406f0f0 0x7f35340b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47400/0 (socket says 172.21.15.167:47400) 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 -- 172.21.15.167:0/1922784653 learned_addr learned my addr 172.21.15.167:0/1922784653 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 -- 172.21.15.167:0/1922784653 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 msgr2=0x7f353414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 --2- 172.21.15.167:0/1922784653 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 0x7f353414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 -- 172.21.15.167:0/1922784653 >> v1:172.21.15.190:6789/0 conn(0x7f3534070bb0 legacy=0x7f353413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 -- 172.21.15.167:0/1922784653 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534071df0 con 0x7f353406f0f0 2024-09-13T17:20:56.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353915c640 1 --2- 172.21.15.167:0/1922784653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f353406f0f0 0x7f35340b0960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f352c0098a0 tx=0x7f352c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858e899d0ba172ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f3533fff640 1 -- 172.21.15.167:0/1922784653 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0ac600 con 0x7f353406f0f0 2024-09-13T17:20:56.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f3533fff640 1 -- 172.21.15.167:0/1922784653 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0a8050 con 0x7f353406f0f0 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f3533fff640 1 -- 172.21.15.167:0/1922784653 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0ac980 con 0x7f353406f0f0 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- 172.21.15.167:0/1922784653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f353406f0f0 msgr2=0x7f35340b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1922784653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f353406f0f0 0x7f35340b0960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f352c0098a0 tx=0x7f352c01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- 172.21.15.167:0/1922784653 shutdown_connections 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1922784653 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 0x7f353414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1922784653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f353406f0f0 0x7f35340b0960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- 172.21.15.167:0/1922784653 >> 172.21.15.167:0/1922784653 conn(0x7f35340b7250 msgr2=0x7f35340b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- 172.21.15.167:0/1922784653 shutdown_connections 2024-09-13T17:20:56.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.143+0000 7f353b3c0640 1 -- 172.21.15.167:0/1922784653 wait complete. 2024-09-13T17:20:56.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 Processor -- start 2024-09-13T17:20:56.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 -- start start 2024-09-13T17:20:56.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f353406f0f0 0x7f3534143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3534070bb0 0x7f35341df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 0x7f3534136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534135df0 con 0x7f3534070bb0 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35341df160 con 0x7f353406f0f0 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534137170 con 0x7f3534070ff0 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3534070bb0 0x7f35341df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3534070bb0 0x7f35341df8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47408/0 (socket says 172.21.15.167:47408) 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 -- 172.21.15.167:0/1118244111 learned_addr learned my addr 172.21.15.167:0/1118244111 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 -- 172.21.15.167:0/1118244111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 msgr2=0x7f3534136810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 0x7f3534136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 -- 172.21.15.167:0/1118244111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f353406f0f0 msgr2=0x7f3534143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f353406f0f0 0x7f3534143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 -- 172.21.15.167:0/1118244111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0094d0 con 0x7f3534070bb0 2024-09-13T17:20:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353895b640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3534070bb0 0x7f35341df8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f352000c4c0 tx=0x7f3520001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f3531ffb640 1 -- 172.21.15.167:0/1118244111 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520005480 con 0x7f3534070bb0 2024-09-13T17:20:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f3531ffb640 1 -- 172.21.15.167:0/1118244111 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520003600 con 0x7f3534070bb0 2024-09-13T17:20:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3534072400 con 0x7f3534070bb0 2024-09-13T17:20:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f3531ffb640 1 -- 172.21.15.167:0/1118244111 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520003990 con 0x7f3534070bb0 2024-09-13T17:20:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35341362e0 con 0x7f3534070bb0 2024-09-13T17:20:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3534072260 con 0x7f3534070bb0 2024-09-13T17:20:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f3531ffb640 1 -- 172.21.15.167:0/1118244111 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3520003af0 con 0x7f3534070bb0 2024-09-13T17:20:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.147+0000 7f3531ffb640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f351c066690 0x7f351c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.151+0000 7f3531ffb640 1 -- 172.21.15.167:0/1118244111 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35200834e0 con 0x7f3534070bb0 2024-09-13T17:20:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.151+0000 7f353915c640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f351c066690 0x7f351c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.151+0000 7f353915c640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f351c066690 0x7f351c068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f352c0ae000 tx=0x7f352c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.155+0000 7f3531ffb640 1 -- 172.21.15.167:0/1118244111 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3534072260 con 0x7f3534070bb0 2024-09-13T17:20:56.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.299+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35341df610 con 0x7f3534070bb0 2024-09-13T17:20:56.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f3531ffb640 1 -- 172.21.15.167:0/1118244111 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f35341df610 con 0x7f3534070bb0 2024-09-13T17:20:56.304 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:56.304 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f351c066690 msgr2=0x7f351c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f351c066690 0x7f351c068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f352c0ae000 tx=0x7f352c008040 comp rx=0 tx=0).stop 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3534070bb0 msgr2=0x7f35341df8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3534070bb0 0x7f35341df8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f352000c4c0 tx=0x7f3520001e80 comp rx=0 tx=0).stop 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 shutdown_connections 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f351c066690 0x7f351c068b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3534070ff0 0x7f3534136810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3534070bb0 0x7f35341df8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 --2- 172.21.15.167:0/1118244111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f353406f0f0 0x7f3534143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 >> 172.21.15.167:0/1118244111 conn(0x7f35340b7250 msgr2=0x7f35340b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 shutdown_connections 2024-09-13T17:20:56.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.303+0000 7f353b3c0640 1 -- 172.21.15.167:0/1118244111 wait complete. 2024-09-13T17:20:56.337 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:20:56.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf752e5640 1 Processor -- start 2024-09-13T17:20:56.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf752e5640 1 -- start start 2024-09-13T17:20:56.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf752e5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faf700b4000 0x7faf70149930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf752e5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faf701464a0 0x7faf7013ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf752e5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf70149170 con 0x7faf7013fb40 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf752e5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700b50c0 con 0x7faf700b4000 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf752e5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700b43e0 con 0x7faf701464a0 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faf700b4000 0x7faf70149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faf700b4000 0x7faf70149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47414/0 (socket says 172.21.15.167:47414) 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6effd640 1 -- 172.21.15.167:0/456961759 learned_addr learned my addr 172.21.15.167:0/456961759 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6effd640 1 -- 172.21.15.167:0/456961759 >> v2:172.21.15.190:3300/0 conn(0x7faf701464a0 msgr2=0x7faf7013ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6f7fe640 1 --2- 172.21.15.167:0/456961759 >> v2:172.21.15.190:3300/0 conn(0x7faf701464a0 0x7faf7013ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6effd640 1 --2- 172.21.15.167:0/456961759 >> v2:172.21.15.190:3300/0 conn(0x7faf701464a0 0x7faf7013ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6effd640 1 -- 172.21.15.167:0/456961759 >> v1:172.21.15.167:6789/0 conn(0x7faf7013fb40 legacy=0x7faf70145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6effd640 1 -- 172.21.15.167:0/456961759 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf70146aa0 con 0x7faf700b4000 2024-09-13T17:20:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.459+0000 7faf6dffb640 1 -- 172.21.15.167:0/456961759 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647498286 0 0) 0x7faf70149170 con 0x7faf7013fb40 2024-09-13T17:20:56.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6effd640 1 --2- 172.21.15.167:0/456961759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf700b4000 0x7faf70149930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf70071a00 tx=0x7faf6001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ac269e49885333 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6dffb640 1 -- 172.21.15.167:0/456961759 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600ab600 con 0x7faf700b4000 2024-09-13T17:20:56.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6dffb640 1 -- 172.21.15.167:0/456961759 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf600ab760 con 0x7faf700b4000 2024-09-13T17:20:56.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6dffb640 1 -- 172.21.15.167:0/456961759 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600abaf0 con 0x7faf700b4000 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- 172.21.15.167:0/456961759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf700b4000 msgr2=0x7faf70149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 --2- 172.21.15.167:0/456961759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf700b4000 0x7faf70149930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf70071a00 tx=0x7faf6001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- 172.21.15.167:0/456961759 shutdown_connections 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 --2- 172.21.15.167:0/456961759 >> v2:172.21.15.190:3300/0 conn(0x7faf701464a0 0x7faf7013ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 --2- 172.21.15.167:0/456961759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf700b4000 0x7faf70149930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- 172.21.15.167:0/456961759 >> 172.21.15.167:0/456961759 conn(0x7faf7009b150 msgr2=0x7faf7009b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- 172.21.15.167:0/456961759 shutdown_connections 2024-09-13T17:20:56.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- 172.21.15.167:0/456961759 wait complete. 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 Processor -- start 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- start start 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf700b4000 0x7faf700ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf7013fb40 0x7faf700af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf701464a0 0x7faf700afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf70098c00 con 0x7faf701464a0 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7013d6a0 con 0x7faf700b4000 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf70141060 con 0x7faf7013fb40 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf701464a0 0x7faf700afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf701464a0 0x7faf700afaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47418/0 (socket says 172.21.15.167:47418) 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 -- 172.21.15.167:0/1889572975 learned_addr learned my addr 172.21.15.167:0/1889572975 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6effd640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf700b4000 0x7faf700ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 -- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf7013fb40 msgr2=0x7faf700af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf7013fb40 0x7faf700af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 -- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf700b4000 msgr2=0x7faf700ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf700b4000 0x7faf700ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 -- 172.21.15.167:0/1889572975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600094d0 con 0x7faf701464a0 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6effd640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf700b4000 0x7faf700ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf6f7fe640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf701464a0 0x7faf700afaa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf6800cc60 tx=0x7faf6800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf577fe640 1 -- 172.21.15.167:0/1889572975 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800ce70 con 0x7faf701464a0 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf577fe640 1 -- 172.21.15.167:0/1889572975 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680039a0 con 0x7faf701464a0 2024-09-13T17:20:56.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700b0080 con 0x7faf701464a0 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf577fe640 1 -- 172.21.15.167:0/1889572975 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68003d30 con 0x7faf701464a0 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.463+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf70099050 con 0x7faf701464a0 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.467+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf70098d70 con 0x7faf701464a0 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.467+0000 7faf577fe640 1 -- 172.21.15.167:0/1889572975 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf68003e90 con 0x7faf701464a0 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.467+0000 7faf577fe640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf5c066690 0x7faf5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.467+0000 7faf6effd640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf5c066690 0x7faf5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.467+0000 7faf577fe640 1 -- 172.21.15.167:0/1889572975 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf68084890 con 0x7faf701464a0 2024-09-13T17:20:56.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.467+0000 7faf6effd640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf5c066690 0x7faf5c068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf600af000 tx=0x7faf600a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.471+0000 7faf577fe640 1 -- 172.21.15.167:0/1889572975 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf70098d70 con 0x7faf701464a0 2024-09-13T17:20:56.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.659+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf70098d40 con 0x7faf701464a0 2024-09-13T17:20:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf577fe640 1 -- 172.21.15.167:0/1889572975 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3221 (secure 0 0 0) 0x7faf6801d020 con 0x7faf701464a0 2024-09-13T17:20:56.663 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:56.663 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:20:55.351907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:20:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 6 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf5c066690 msgr2=0x7faf5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf5c066690 0x7faf5c068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf600af000 tx=0x7faf600a7000 comp rx=0 tx=0).stop 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf701464a0 msgr2=0x7faf700afaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf701464a0 0x7faf700afaa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf6800cc60 tx=0x7faf6800a5c0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 shutdown_connections 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf5c066690 0x7faf5c068b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf701464a0 0x7faf700afaa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf7013fb40 0x7faf700af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 --2- 172.21.15.167:0/1889572975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf700b4000 0x7faf700ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 >> 172.21.15.167:0/1889572975 conn(0x7faf7009b150 msgr2=0x7faf7006d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 shutdown_connections 2024-09-13T17:20:56.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.663+0000 7faf752e5640 1 -- 172.21.15.167:0/1889572975 wait complete. 2024-09-13T17:20:56.680 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:20:56.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 Processor -- start 2024-09-13T17:20:56.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 -- start start 2024-09-13T17:20:56.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa19806d7f0 0x7fa1980b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa198145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1981463f0 0x7fa198142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa198145a60 con 0x7fa19806d7f0 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1980b4940 con 0x7fa1981463f0 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ef14640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19806e030 con 0x7fa19806dbd0 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa19806d7f0 0x7fa1980b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa19806d7f0 0x7fa1980b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47432/0 (socket says 172.21.15.167:47432) 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 -- 172.21.15.167:0/1405837379 learned_addr learned my addr 172.21.15.167:0/1405837379 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19d4b1640 1 --2- 172.21.15.167:0/1405837379 >> v2:172.21.15.190:3300/0 conn(0x7fa1981463f0 0x7fa198142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa197fff640 1 --2- 172.21.15.167:0/1405837379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa198145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 -- 172.21.15.167:0/1405837379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 msgr2=0x7fa198145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 --2- 172.21.15.167:0/1405837379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa198145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 -- 172.21.15.167:0/1405837379 >> v2:172.21.15.190:3300/0 conn(0x7fa1981463f0 msgr2=0x7fa198142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 --2- 172.21.15.167:0/1405837379 >> v2:172.21.15.190:3300/0 conn(0x7fa1981463f0 0x7fa198142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 -- 172.21.15.167:0/1405837379 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198146860 con 0x7fa19806d7f0 2024-09-13T17:20:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa197fff640 1 --2- 172.21.15.167:0/1405837379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa198145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa19ccb0640 1 --2- 172.21.15.167:0/1405837379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa1980b3da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa19806ab40 tx=0x7fa18401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb795515e7b95d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa1977fe640 1 -- 172.21.15.167:0/1405837379 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840aa610 con 0x7fa19806d7f0 2024-09-13T17:20:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa1977fe640 1 -- 172.21.15.167:0/1405837379 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1840a6040 con 0x7fa19806d7f0 2024-09-13T17:20:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.799+0000 7fa1977fe640 1 -- 172.21.15.167:0/1405837379 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840aa990 con 0x7fa19806d7f0 2024-09-13T17:20:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/1405837379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 msgr2=0x7fa1980b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 --2- 172.21.15.167:0/1405837379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa1980b3da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa19806ab40 tx=0x7fa18401c4f0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/1405837379 shutdown_connections 2024-09-13T17:20:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 --2- 172.21.15.167:0/1405837379 >> v2:172.21.15.190:3300/0 conn(0x7fa1981463f0 0x7fa198142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 --2- 172.21.15.167:0/1405837379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa198145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 --2- 172.21.15.167:0/1405837379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa1980b3da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/1405837379 >> 172.21.15.167:0/1405837379 conn(0x7fa19809b150 msgr2=0x7fa19809b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/1405837379 shutdown_connections 2024-09-13T17:20:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/1405837379 wait complete. 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 Processor -- start 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- start start 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa19809a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa1980af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1981463f0 0x7fa1980af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19809a5a0 con 0x7fa19806d7f0 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19809cea0 con 0x7fa1981463f0 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980aedd0 con 0x7fa19806dbd0 2024-09-13T17:20:56.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa19809a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa19809a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47442/0 (socket says 172.21.15.167:47442) 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 -- 172.21.15.167:0/385439196 learned_addr learned my addr 172.21.15.167:0/385439196 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 -- 172.21.15.167:0/385439196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 msgr2=0x7fa1980af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19d4b1640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1981463f0 0x7fa1980af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa1980af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 -- 172.21.15.167:0/385439196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1981463f0 msgr2=0x7fa1980af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1981463f0 0x7fa1980af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 -- 172.21.15.167:0/385439196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840094d0 con 0x7fa19806d7f0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ccb0640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa19809a060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa18401aba0 tx=0x7fa18401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa1957fa640 1 -- 172.21.15.167:0/385439196 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840bd5f0 con 0x7fa19806d7f0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa1957fa640 1 -- 172.21.15.167:0/385439196 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1840bd750 con 0x7fa19806d7f0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19809c4c0 con 0x7fa19806d7f0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa1957fa640 1 -- 172.21.15.167:0/385439196 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840bdae0 con 0x7fa19806d7f0 2024-09-13T17:20:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19809c7e0 con 0x7fa19806d7f0 2024-09-13T17:20:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.803+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa198149d70 con 0x7fa19806d7f0 2024-09-13T17:20:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.807+0000 7fa1957fa640 1 -- 172.21.15.167:0/385439196 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1840b33f0 con 0x7fa19806d7f0 2024-09-13T17:20:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.807+0000 7fa1957fa640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa17c066690 0x7fa17c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.807+0000 7fa1957fa640 1 -- 172.21.15.167:0/385439196 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa18411e9b0 con 0x7fa19806d7f0 2024-09-13T17:20:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.807+0000 7fa197fff640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa17c066690 0x7fa17c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.807+0000 7fa197fff640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa17c066690 0x7fa17c068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa19809a850 tx=0x7fa18c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.811+0000 7fa1957fa640 1 -- 172.21.15.167:0/385439196 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1840ebae0 con 0x7fa19806d7f0 2024-09-13T17:20:56.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.971+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa19806ac80 con 0x7fa19806d7f0 2024-09-13T17:20:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.975+0000 7fa1957fa640 1 -- 172.21.15.167:0/385439196 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fa1840c3090 con 0x7fa19806d7f0 2024-09-13T17:20:56.978 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:20:56.978 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:20:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa17c066690 msgr2=0x7fa17c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa17c066690 0x7fa17c068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa19809a850 tx=0x7fa18c008040 comp rx=0 tx=0).stop 2024-09-13T17:20:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 msgr2=0x7fa19809a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa19809a060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa18401aba0 tx=0x7fa18401ad30 comp rx=0 tx=0).stop 2024-09-13T17:20:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 shutdown_connections 2024-09-13T17:20:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa17c066690 0x7fa17c068b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1981463f0 0x7fa1980af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa19806dbd0 0x7fa1980af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 --2- 172.21.15.167:0/385439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa19806d7f0 0x7fa19809a060 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 >> 172.21.15.167:0/385439196 conn(0x7fa19809b150 msgr2=0x7fa198141250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 shutdown_connections 2024-09-13T17:20:56.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:56.979+0000 7fa19ef14640 1 -- 172.21.15.167:0/385439196 wait complete. 2024-09-13T17:20:57.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:20:50.924847+0000', 'modified': '2024-09-13T17:20:55.351907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6835/583998386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 583998386}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 583998386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T17:20:57.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:20:57.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:20:57.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feb0013f640 1 Processor -- start 2024-09-13T17:20:57.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feb0013f640 1 -- start start 2024-09-13T17:20:57.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feb0013f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feaf80717d0 0x7feaf80b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feb0013f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf8071bb0 con 0x7feaf8071f10 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feb0013f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf80723a0 con 0x7feaf80b63c0 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feb0013f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf8070740 con 0x7feaf80717d0 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feafdedb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feaf80717d0 0x7feaf80b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feafd6da640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feaf8071f10 0x7feaf8140880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44922/0 (socket says 172.21.15.167:44922) 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feafd6da640 1 -- 172.21.15.167:0/2768618245 learned_addr learned my addr 172.21.15.167:0/2768618245 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feafdedb640 1 -- 172.21.15.167:0/2768618245 >> v1:172.21.15.190:6789/0 conn(0x7feaf80b63c0 legacy=0x7feaf814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feafdedb640 1 -- 172.21.15.167:0/2768618245 >> v1:172.21.15.167:6789/0 conn(0x7feaf8071f10 legacy=0x7feaf8140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.323+0000 7feafdedb640 1 -- 172.21.15.167:0/2768618245 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8070a20 con 0x7feaf80717d0 2024-09-13T17:20:57.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feafdedb640 1 --2- 172.21.15.167:0/2768618245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80717d0 0x7feaf80b5e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feaf00097c0 tx=0x7feaf001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6648c02ccb600386 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feafced9640 1 -- 172.21.15.167:0/2768618245 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00ad680 con 0x7feaf80717d0 2024-09-13T17:20:57.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feafced9640 1 -- 172.21.15.167:0/2768618245 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf00ad7e0 con 0x7feaf80717d0 2024-09-13T17:20:57.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feafced9640 1 -- 172.21.15.167:0/2768618245 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00adb70 con 0x7feaf80717d0 2024-09-13T17:20:57.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 -- 172.21.15.167:0/2768618245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80717d0 msgr2=0x7feaf80b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 --2- 172.21.15.167:0/2768618245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80717d0 0x7feaf80b5e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feaf00097c0 tx=0x7feaf001c460 comp rx=0 tx=0).stop 2024-09-13T17:20:57.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 -- 172.21.15.167:0/2768618245 shutdown_connections 2024-09-13T17:20:57.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 --2- 172.21.15.167:0/2768618245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80717d0 0x7feaf80b5e80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 -- 172.21.15.167:0/2768618245 >> 172.21.15.167:0/2768618245 conn(0x7feaf80b9570 msgr2=0x7feaf80b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 -- 172.21.15.167:0/2768618245 shutdown_connections 2024-09-13T17:20:57.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 -- 172.21.15.167:0/2768618245 wait complete. 2024-09-13T17:20:57.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 Processor -- start 2024-09-13T17:20:57.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 -- start start 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf80717d0 0x7feaf8099cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.327+0000 7feb0013f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b63c0 0x7feaf8146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb0013f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80b0240 0x7feaf81df790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb0013f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80afad0 con 0x7feaf80b0240 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb0013f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8146690 con 0x7feaf80717d0 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb0013f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8146910 con 0x7feaf80b63c0 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80b0240 0x7feaf81df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80b0240 0x7feaf81df790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56278/0 (socket says 172.21.15.167:56278) 2024-09-13T17:20:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 -- 172.21.15.167:0/2813209948 learned_addr learned my addr 172.21.15.167:0/2813209948 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafdedb640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf80717d0 0x7feaf8099cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 -- 172.21.15.167:0/2813209948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b63c0 msgr2=0x7feaf8146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b63c0 0x7feaf8146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 -- 172.21.15.167:0/2813209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf80717d0 msgr2=0x7feaf8099cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf80717d0 0x7feaf8099cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 -- 172.21.15.167:0/2813209948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf0009420 con 0x7feaf80b0240 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafe6dc640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80b0240 0x7feaf81df790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feae800b440 tx=0x7feae800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feaf67fc640 1 -- 172.21.15.167:0/2813209948 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8011830 con 0x7feaf80b0240 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feaf67fc640 1 -- 172.21.15.167:0/2813209948 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80119d0 con 0x7feaf80b0240 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf81477c0 con 0x7feaf80b0240 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feaf67fc640 1 -- 172.21.15.167:0/2813209948 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8011d80 con 0x7feaf80b0240 2024-09-13T17:20:57.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf81dfcd0 con 0x7feaf80b0240 2024-09-13T17:20:57.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feaf67fc640 1 -- 172.21.15.167:0/2813209948 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feae801a400 con 0x7feaf80b0240 2024-09-13T17:20:57.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feaf67fc640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feae4066690 0x7feae4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafdedb640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feae4066690 0x7feae4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feaf67fc640 1 -- 172.21.15.167:0/2813209948 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feae80844d0 con 0x7feaf80b0240 2024-09-13T17:20:57.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feafdedb640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feae4066690 0x7feae4068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feaf00af000 tx=0x7feaf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb03288000 1 Processor -- start 2024-09-13T17:20:57.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb03288000 1 -- start start 2024-09-13T17:20:57.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.331+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851a91660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851ac3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac35d0 0x55f851ac59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f851952e80 con 0x55f851ac0ca0 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8518e0af0 con 0x55f851a91280 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8518de0c0 con 0x55f851ac35d0 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851ac3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851ac3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56292/0 (socket says 172.21.15.167:56292) 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 -- 172.21.15.167:0/172141892 learned_addr learned my addr 172.21.15.167:0/172141892 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafdedb640 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851a91660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac35d0 0x55f851ac59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 -- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac35d0 msgr2=0x55f851ac59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac35d0 0x55f851ac59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 -- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 msgr2=0x55f851a91660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851a91660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 -- 172.21.15.167:0/172141892 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8515d5890 con 0x55f851ac0ca0 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851ac3090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaec001ff0 tx=0x7feaec00c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800447b1b1eedcaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadf7fe640 1 -- 172.21.15.167:0/172141892 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0070d0 con 0x55f851ac0ca0 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadf7fe640 1 -- 172.21.15.167:0/172141892 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec007230 con 0x55f851ac0ca0 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadf7fe640 1 -- 172.21.15.167:0/172141892 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0075a0 con 0x55f851ac0ca0 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/172141892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 msgr2=0x55f851ac3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851ac3090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaec001ff0 tx=0x7feaec00c4b0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/172141892 shutdown_connections 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac35d0 0x55f851ac59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851ac3090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- 172.21.15.167:0/172141892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851a91660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/172141892 >> 172.21.15.167:0/172141892 conn(0x55f851ab67e0 msgr2=0x55f851ab8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/172141892 shutdown_connections 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/172141892 wait complete. 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- start start 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 Processor -- start 2024-09-13T17:20:57.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ab61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac0ca0 0x55f851aba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac35d0 0x55f851aba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8518d99b0 con 0x55f851ac35d0 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f851878c00 con 0x55f851a91280 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f851897070 con 0x55f851ac0ca0 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 10 client.0 _ll_register_callbacks cb 0x55f851a76ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac35d0 0x55f851aba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac35d0 0x55f851aba580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56308/0 (socket says 172.21.15.167:56308) 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 -- 172.21.15.167:0/4273269134 learned_addr learned my addr 172.21.15.167:0/4273269134 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafd6da640 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac0ca0 0x55f851aba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafdedb640 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ab61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 -- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac0ca0 msgr2=0x55f851aba040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac0ca0 0x55f851aba040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 -- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 msgr2=0x55f851ab61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ab61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 -- 172.21.15.167:0/4273269134 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf8071bb0 con 0x55f851ac35d0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafe6dc640 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac35d0 0x55f851aba580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feae80826a0 tx=0x7feae8054c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539c380f9bd97f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadcff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadcff9640 1 -- 172.21.15.167:0/4273269134 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae805d5f0 con 0x55f851ac35d0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadcff9640 1 -- 172.21.15.167:0/4273269134 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feae80840b0 con 0x55f851ac35d0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8518965f0 con 0x55f851ac35d0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadcff9640 1 -- 172.21.15.167:0/4273269134 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7feae8084270 con 0x55f851ac35d0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 10 client.4431 fetch_fsmap learned FSMap version 6 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55f85189eab0 con 0x55f851ac35d0 2024-09-13T17:20:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadcff9640 1 -- 172.21.15.167:0/4273269134 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8518965f0 con 0x55f851ac35d0 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feadcff9640 1 -- 172.21.15.167:0/4273269134 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 6) v1 ==== 2032+0+0 (secure 0 0 0) 0x7feae8058030 con 0x55f851ac35d0 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 10 client.4431 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 10 client.4431 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 20 client.4431 populate_metadata read hostname 'smithi167' 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851abb320 0x55f851ad0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 4 client.4431 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 --> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8518d6790 con 0x55f851abb320 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.335+0000 7feafdedb640 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851abb320 0x55f851ad0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feadcff9640 10 client.4431 ms_handle_connect on v2:172.21.15.167:6834/583998386 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feafdedb640 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851abb320 0x55f851ad0d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3acd215bf797663 server_cookie=5b2d48d4875d2f0c in_seq=0 out_seq=0 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feadcff9640 1 -- 172.21.15.167:0/4273269134 <== mds.0 v2:172.21.15.167:6834/583998386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f8518d6790 con 0x55f851abb320 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feadcff9640 10 client.4431 handle_command_reply: tid=0 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 client.4431 shutdown 2024-09-13T17:20:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac35d0 msgr2=0x55f851aba580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac35d0 0x55f851aba580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feae80826a0 tx=0x7feae8054c50 comp rx=0 tx=0).stop 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 shutdown_connections 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851abb320 0x55f851ad0d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac35d0 0x55f851aba580 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ac0ca0 0x55f851aba040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feadcff9640 0 client.4431 ms_handle_reset on v2:172.21.15.167:6834/583998386 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 --2- 172.21.15.167:0/4273269134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ab61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 >> 172.21.15.167:0/4273269134 conn(0x55f851ab67e0 msgr2=0x55f851ac1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 shutdown_connections 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 1 -- 172.21.15.167:0/4273269134 wait complete. 2024-09-13T17:20:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.339+0000 7feb03288000 20 client.4431 trim_cache size 0 max 16384 2024-09-13T17:20:57.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.351+0000 7feb03288000 1 Processor -- start 2024-09-13T17:20:57.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.351+0000 7feb03288000 1 -- start start 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ab67e0 0x55f851ad2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851a91280 0x55f851ad3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851ac0ca0 0x55f851ab8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f851596940 con 0x55f851ab67e0 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8518d71c0 con 0x55f851ac0ca0 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8518e1d80 con 0x55f851a91280 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ab67e0 0x55f851ad2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ab67e0 0x55f851ad2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56320/0 (socket says 172.21.15.167:56320) 2024-09-13T17:20:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 -- 172.21.15.167:0/3243778505 learned_addr learned my addr 172.21.15.167:0/3243778505 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 -- 172.21.15.167:0/3243778505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851a91280 msgr2=0x55f851ad3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 --2- 172.21.15.167:0/3243778505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851a91280 0x55f851ad3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 -- 172.21.15.167:0/3243778505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851ac0ca0 msgr2=0x55f851ab8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 --2- 172.21.15.167:0/3243778505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851ac0ca0 0x55f851ab8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 -- 172.21.15.167:0/3243778505 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f851884c00 con 0x55f851ab67e0 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 --2- 172.21.15.167:0/3243778505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ab67e0 0x55f851ad2d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feaf0000c10 tx=0x7feaf0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6b224d8985f1b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feadffff640 1 -- 172.21.15.167:0/3243778505 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00be040 con 0x55f851ab67e0 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feadffff640 1 -- 172.21.15.167:0/3243778505 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf00b6a50 con 0x55f851ab67e0 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feadffff640 1 -- 172.21.15.167:0/3243778505 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00b6dc0 con 0x55f851ab67e0 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- 172.21.15.167:0/3243778505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ab67e0 msgr2=0x55f851ad2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- 172.21.15.167:0/3243778505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ab67e0 0x55f851ad2d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feaf0000c10 tx=0x7feaf0004740 comp rx=0 tx=0).stop 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- 172.21.15.167:0/3243778505 shutdown_connections 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- 172.21.15.167:0/3243778505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851ac0ca0 0x55f851ab8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- 172.21.15.167:0/3243778505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851a91280 0x55f851ad3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- 172.21.15.167:0/3243778505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ab67e0 0x55f851ad2d40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- 172.21.15.167:0/3243778505 >> 172.21.15.167:0/3243778505 conn(0x55f851abf230 msgr2=0x55f851ab6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- 172.21.15.167:0/3243778505 shutdown_connections 2024-09-13T17:20:57.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- 172.21.15.167:0/3243778505 wait complete. 2024-09-13T17:20:57.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- start start 2024-09-13T17:20:57.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 Processor -- start 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ad2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ab67e0 0x55f851af0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851af0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85191c5f0 con 0x55f851ac0ca0 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f851876c10 con 0x55f851a91280 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f851abc1e0 con 0x55f851ab67e0 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 10 client.0 _ll_register_callbacks cb 0x55f851a56e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851af0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851af0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56336/0 (socket says 172.21.15.167:56336) 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 -- 172.21.15.167:0/2764938105 learned_addr learned my addr 172.21.15.167:0/2764938105 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ad2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 -- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ab67e0 msgr2=0x55f851af0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafd6da640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ab67e0 0x55f851af0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ab67e0 0x55f851af0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 -- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 msgr2=0x55f851ad2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ad2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 -- 172.21.15.167:0/2764938105 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf8070a20 con 0x55f851ac0ca0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafdedb640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ad2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feafe6dc640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851af0d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feae800bfd0 tx=0x7feae8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6825b24565582fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feadcff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feadcff9640 1 -- 172.21.15.167:0/2764938105 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8077070 con 0x55f851ac0ca0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feadcff9640 1 -- 172.21.15.167:0/2764938105 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feae8051910 con 0x55f851ac0ca0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8518a9460 con 0x55f851ac0ca0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feadcff9640 1 -- 172.21.15.167:0/2764938105 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7feae8009170 con 0x55f851ac0ca0 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 10 client.4437 fetch_fsmap learned FSMap version 6 2024-09-13T17:20:57.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.355+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55f8515d5cc0 con 0x55f851ac0ca0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feadcff9640 1 -- 172.21.15.167:0/2764938105 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8061070 con 0x55f851ac0ca0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feadcff9640 1 -- 172.21.15.167:0/2764938105 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 6) v1 ==== 2032+0+0 (secure 0 0 0) 0x7feae807a030 con 0x55f851ac0ca0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 10 client.4437 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 10 client.4437 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 20 client.4437 populate_metadata read hostname 'smithi167' 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851ac35d0 0x55f851af12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 4 client.4437 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 --> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f8518a29c0 con 0x55f851ac35d0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feafdedb640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851ac35d0 0x55f851af12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feadcff9640 10 client.4437 ms_handle_connect on v2:172.21.15.167:6834/583998386 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feafdedb640 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851ac35d0 0x55f851af12d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d179d609e5d978a server_cookie=fc8d2849bc6f5895 in_seq=0 out_seq=0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feadcff9640 1 -- 172.21.15.167:0/2764938105 <== mds.0 v2:172.21.15.167:6834/583998386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55f8518a29c0 con 0x55f851ac35d0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feadcff9640 10 client.4437 handle_command_reply: tid=0 2024-09-13T17:20:57.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 client.4437 shutdown 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 msgr2=0x55f851af0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851af0d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feae800bfd0 tx=0x7feae8011000 comp rx=0 tx=0).stop 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 shutdown_connections 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x55f851ac35d0 0x55f851af12d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f851ac0ca0 0x55f851af0d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feadcff9640 0 client.4437 ms_handle_reset on v2:172.21.15.167:6834/583998386 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f851ab67e0 0x55f851af0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 --2- 172.21.15.167:0/2764938105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f851a91280 0x55f851ad2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 >> 172.21.15.167:0/2764938105 conn(0x55f851abf230 msgr2=0x55f851ab73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 shutdown_connections 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 1 -- 172.21.15.167:0/2764938105 wait complete. 2024-09-13T17:20:57.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb03288000 20 client.4437 trim_cache size 0 max 16384 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "cluster_fsid": "77832f00-b4f4-4330-b095-2fc2c7bace94", 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "whoami": 0, 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4272, 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "want_state": "up:active", 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "up:active", 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs", 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "rank_uptime": 6.432709225, 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsmap_epoch": 6, 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch": 27, 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch_barrier": 26, 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout: "uptime": 12.487461618999999 2024-09-13T17:20:57.367 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:20:57.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feae4066690 msgr2=0x7feae4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feae4066690 0x7feae4068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feaf00af000 tx=0x7feaf0008040 comp rx=0 tx=0).stop 2024-09-13T17:20:57.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80b0240 msgr2=0x7feaf81df790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80b0240 0x7feaf81df790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feae800b440 tx=0x7feae800b900 comp rx=0 tx=0).stop 2024-09-13T17:20:57.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 shutdown_connections 2024-09-13T17:20:57.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feae4066690 0x7feae4068b50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf80b0240 0x7feaf81df790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaf80b63c0 0x7feaf8146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 --2- 172.21.15.167:0/2813209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaf80717d0 0x7feaf8099cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 >> 172.21.15.167:0/2813209948 conn(0x7feaf80b9570 msgr2=0x7feaf809b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 shutdown_connections 2024-09-13T17:20:57.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.359+0000 7feb0013f640 1 -- 172.21.15.167:0/2813209948 wait complete. 2024-09-13T17:20:57.376 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:20:57.376 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:20:57.376 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:20:57.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.475+0000 7f92f3d99640 1 Processor -- start 2024-09-13T17:20:57.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.475+0000 7f92f3d99640 1 -- start start 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f3d99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec06f0f0 0x7f92ec0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f3d99640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f92ec070ff0 0x7f92ec14e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f3d99640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec071b10 con 0x7f92ec070bb0 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f3d99640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec06f7f0 con 0x7f92ec070ff0 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f3d99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0b0ea0 con 0x7f92ec06f0f0 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f92ec070ff0 0x7f92ec14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f92ec070ff0 0x7f92ec14e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56338/0 (socket says 172.21.15.167:56338) 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 -- 172.21.15.167:0/907070470 learned_addr learned my addr 172.21.15.167:0/907070470 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f1334640 1 --1- 172.21.15.167:0/907070470 >> v1:172.21.15.167:6789/0 conn(0x7f92ec070bb0 0x7f92ec13d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44926/0 (socket says 172.21.15.167:44926) 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f1b35640 1 --2- 172.21.15.167:0/907070470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec06f0f0 0x7f92ec0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 -- 172.21.15.167:0/907070470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec06f0f0 msgr2=0x7f92ec0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 --2- 172.21.15.167:0/907070470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec06f0f0 0x7f92ec0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 -- 172.21.15.167:0/907070470 >> v1:172.21.15.167:6789/0 conn(0x7f92ec070bb0 legacy=0x7f92ec13d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 -- 172.21.15.167:0/907070470 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec071df0 con 0x7f92ec070ff0 2024-09-13T17:20:57.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f0b33640 1 -- 172.21.15.167:0/907070470 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342526634 0 0) 0x7f92ec071b10 con 0x7f92ec070bb0 2024-09-13T17:20:57.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f2336640 1 --2- 172.21.15.167:0/907070470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec070ff0 0x7f92ec14e160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0098a0 tx=0x7f92dc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa883099fc3f96a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f0b33640 1 -- 172.21.15.167:0/907070470 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0ab620 con 0x7f92ec070ff0 2024-09-13T17:20:57.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f0b33640 1 -- 172.21.15.167:0/907070470 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc0ab780 con 0x7f92ec070ff0 2024-09-13T17:20:57.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.479+0000 7f92f0b33640 1 -- 172.21.15.167:0/907070470 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0abb10 con 0x7f92ec070ff0 2024-09-13T17:20:57.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/907070470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec070ff0 msgr2=0x7f92ec14e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 --2- 172.21.15.167:0/907070470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec070ff0 0x7f92ec14e160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0098a0 tx=0x7f92dc01c420 comp rx=0 tx=0).stop 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/907070470 shutdown_connections 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 --2- 172.21.15.167:0/907070470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec070ff0 0x7f92ec14e160 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 --2- 172.21.15.167:0/907070470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec06f0f0 0x7f92ec0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/907070470 >> 172.21.15.167:0/907070470 conn(0x7f92ec0b7250 msgr2=0x7f92ec0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/907070470 shutdown_connections 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/907070470 wait complete. 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 Processor -- start 2024-09-13T17:20:57.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- start start 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec06f0f0 0x7f92ec148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec070bb0 0x7f92ec1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ec070ff0 0x7f92ec13a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec147150 con 0x7f92ec06f0f0 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec147920 con 0x7f92ec070ff0 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec1498c0 con 0x7f92ec070bb0 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec06f0f0 0x7f92ec148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec06f0f0 0x7f92ec148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56354/0 (socket says 172.21.15.167:56354) 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 -- 172.21.15.167:0/4091859307 learned_addr learned my addr 172.21.15.167:0/4091859307 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 -- 172.21.15.167:0/4091859307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec070bb0 msgr2=0x7f92ec1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec070bb0 0x7f92ec1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 -- 172.21.15.167:0/4091859307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ec070ff0 msgr2=0x7f92ec13a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f2336640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ec070ff0 0x7f92ec13a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ec070ff0 0x7f92ec13a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 -- 172.21.15.167:0/4091859307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0094d0 con 0x7f92ec06f0f0 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f1b35640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec06f0f0 0x7f92ec148180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92e4007ef0 tx=0x7f92e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92ea7fc640 1 -- 172.21.15.167:0/4091859307 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4014620 con 0x7f92ec06f0f0 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92ea7fc640 1 -- 172.21.15.167:0/4091859307 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e4014780 con 0x7f92ec06f0f0 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec149b30 con 0x7f92ec06f0f0 2024-09-13T17:20:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92ea7fc640 1 -- 172.21.15.167:0/4091859307 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4014b30 con 0x7f92ec06f0f0 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec147640 con 0x7f92ec06f0f0 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.483+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec141270 con 0x7f92ec06f0f0 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.487+0000 7f92ea7fc640 1 -- 172.21.15.167:0/4091859307 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92e4014c90 con 0x7f92ec06f0f0 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.487+0000 7f92ea7fc640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f92d8066690 0x7f92d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.487+0000 7f92ea7fc640 1 -- 172.21.15.167:0/4091859307 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92e4084da0 con 0x7f92ec06f0f0 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.487+0000 7f92f1334640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f92d8066690 0x7f92d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.487+0000 7f92f1334640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f92d8066690 0x7f92d8068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92e00011f0 tx=0x7f92e0007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.491+0000 7f92ea7fc640 1 -- 172.21.15.167:0/4091859307 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92e4051eb0 con 0x7f92ec06f0f0 2024-09-13T17:20:57.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92ec06af90 con 0x7f92ec06f0f0 2024-09-13T17:20:57.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92ea7fc640 1 -- 172.21.15.167:0/4091859307 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f92e40554d0 con 0x7f92ec06f0f0 2024-09-13T17:20:57.672 INFO:teuthology.orchestra.run.smithi167.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:20:57.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f92d8066690 msgr2=0x7f92d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f92d8066690 0x7f92d8068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92e00011f0 tx=0x7f92e0007930 comp rx=0 tx=0).stop 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec06f0f0 msgr2=0x7f92ec148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec06f0f0 0x7f92ec148180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92e4007ef0 tx=0x7f92e400e4b0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 shutdown_connections 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f92d8066690 0x7f92d8068b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ec070ff0 0x7f92ec13a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ec070bb0 0x7f92ec1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 --2- 172.21.15.167:0/4091859307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92ec06f0f0 0x7f92ec148180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 >> 172.21.15.167:0/4091859307 conn(0x7f92ec0b7250 msgr2=0x7f92ec13d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 shutdown_connections 2024-09-13T17:20:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:20:57.671+0000 7f92f3d99640 1 -- 172.21.15.167:0/4091859307 wait complete. 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:20:57.689 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:20:57.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:57.690 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-09-13T17:20:57.696 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:20:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:20:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:20:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:20:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:20:57.697 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42485sec preferred_lft 42485sec 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 02:42:7c:99:bf:e5 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:20:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:20:57.699 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:20:57.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:57.699 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:20:57.700 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:20:57.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:20:57.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2024-09-13T17:20:57.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2024-09-13T17:20:57.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:20:57.700 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:20:57.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:57.773 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:20:57.823 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-13T17:20:57.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:57.824 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-09-13T17:20:58.089 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-09-13T17:20:58.089 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:20:58.089 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:20:58.089 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:20:58.089 INFO:teuthology.orchestra.run.smithi167.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:20:58.089 INFO:teuthology.orchestra.run.smithi167.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:20:58.090 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:20:58.090 INFO:teuthology.orchestra.run.smithi167.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:20:58.090 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:20:58.090 INFO:teuthology.orchestra.run.smithi167.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:20:58.090 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:20:58.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.090 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:20:58.090 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:20:58.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:20:58.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:20:58.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:20:58.091 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:20:58.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.128 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-13T17:20:58.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.177 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-09-13T17:20:58.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.224 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:20:58.224 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:20:58.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:20:58.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T17:20:58.224 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:20:58.296 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T17:20:58.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.296 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:20:58.296 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:20:58.296 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T17:20:58.297 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:20:58.297 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T17:20:58.297 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T17:20:58.297 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T17:20:58.297 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:20:58.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.454 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:20:58.454 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:20:58.454 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2024-09-13T17:20:58.454 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:20:58.454 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:20:58.473 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T17:20:58.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:20:58.473 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:20:58.519 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:20:58.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:20:58.519 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:20:58.567 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-13T17:20:58.621 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:20:58.622 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:20:58.676 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:20:58.677 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:20:58.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.677 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-13T17:20:58.728 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:20:58.728 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T17:20:58.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-13T17:20:58.787 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:20:58.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:20:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:20:58.841 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:20:58.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:20:58.842 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-13T17:20:58.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:2024-09-13T17:20:58.851+0000 7fa4c5024580 -1 init, newargv = 0x5650dd1bc0b0 newargc=15 2024-09-13T17:20:58.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:ceph-fuse[34860]: starting ceph client 2024-09-13T17:20:58.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:ceph-fuse[34860]: starting fuse 2024-09-13T17:20:59.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-13T17:20:59.976 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:20:59.977 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:21:00.031 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:21:00.032 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:21:00.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:00.033 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-13T17:21:00.080 INFO:teuthology.orchestra.run.smithi167.stdout:45 2024-09-13T17:21:00.080 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T17:21:00.080 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:21:00.080 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> import re 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> import os 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2024-09-13T17:21:00.081 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> return f 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.admin")) 2024-09-13T17:21:00.082 DEBUG:teuthology.orchestra.run.smithi167:> ' 2024-09-13T17:21:00.200 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.admin.34860.asok 2024-09-13T17:21:00.384 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34860.asok 2024-09-13T17:21:00.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:00.384 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34860.asok status 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "admin", 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "34860", 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2024-09-13T17:21:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4452, 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4452 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 1189959576 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 1189959576 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4452 192.168.0.1:0/1189959576", 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.1:0/1189959576", 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 6, 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 27, 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2024-09-13T17:21:00.543 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:21:00.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:00.554 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2024-09-13T17:21:00.555 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:21:00.560 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2024-09-13T17:21:00.561 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:21:00.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:00.561 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:21:00.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:00.614 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T17:21:00.918 INFO:teuthology.orchestra.run.smithi167.stdout:# file: . 2024-09-13T17:21:00.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T17:21:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:00.919 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:21:00.919 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:21:00.928 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:01.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7682468640 1 Processor -- start 2024-09-13T17:21:01.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7682468640 1 -- start start 2024-09-13T17:21:01.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7682468640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f767c06bde0 0x7f767c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7682468640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f767c0a0b60 0x7f767c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7682468640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c06c1c0 con 0x7f767c0b6690 2024-09-13T17:21:01.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7682468640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c146950 con 0x7f767c06bde0 2024-09-13T17:21:01.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7682468640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c06b380 con 0x7f767c0a0b60 2024-09-13T17:21:01.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f767c06bde0 0x7f767c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f767c0b6690 0x7f767c0a0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44938/0 (socket says 172.21.15.167:44938) 2024-09-13T17:21:01.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f767c06bde0 0x7f767c0b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56362/0 (socket says 172.21.15.167:56362) 2024-09-13T17:21:01.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767b7fe640 1 -- 172.21.15.167:0/808228569 learned_addr learned my addr 172.21.15.167:0/808228569 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:01.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f7680a05640 1 --2- 172.21.15.167:0/808228569 >> v2:172.21.15.190:3300/0 conn(0x7f767c0a0b60 0x7f767c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767bfff640 1 -- 172.21.15.167:0/808228569 >> v2:172.21.15.190:3300/0 conn(0x7f767c0a0b60 msgr2=0x7f767c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767bfff640 1 --2- 172.21.15.167:0/808228569 >> v2:172.21.15.190:3300/0 conn(0x7f767c0a0b60 0x7f767c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767bfff640 1 -- 172.21.15.167:0/808228569 >> v1:172.21.15.167:6789/0 conn(0x7f767c0b6690 legacy=0x7f767c0a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767affd640 1 -- 172.21.15.167:0/808228569 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900651667 0 0) 0x7f767c06c1c0 con 0x7f767c0b6690 2024-09-13T17:21:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.094+0000 7f767bfff640 1 -- 172.21.15.167:0/808228569 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c145e70 con 0x7f767c06bde0 2024-09-13T17:21:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f767bfff640 1 --2- 172.21.15.167:0/808228569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c06bde0 0x7f767c0b6150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f767c0b7240 tx=0x7f766c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff86fa4eef1ea014 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f767affd640 1 -- 172.21.15.167:0/808228569 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab600 con 0x7f767c06bde0 2024-09-13T17:21:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f767affd640 1 -- 172.21.15.167:0/808228569 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c0a7050 con 0x7f767c06bde0 2024-09-13T17:21:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f767affd640 1 -- 172.21.15.167:0/808228569 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab980 con 0x7f767c06bde0 2024-09-13T17:21:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- 172.21.15.167:0/808228569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c06bde0 msgr2=0x7f767c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 --2- 172.21.15.167:0/808228569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c06bde0 0x7f767c0b6150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f767c0b7240 tx=0x7f766c01c3c0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- 172.21.15.167:0/808228569 shutdown_connections 2024-09-13T17:21:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 --2- 172.21.15.167:0/808228569 >> v2:172.21.15.190:3300/0 conn(0x7f767c0a0b60 0x7f767c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 --2- 172.21.15.167:0/808228569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c06bde0 0x7f767c0b6150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- 172.21.15.167:0/808228569 >> 172.21.15.167:0/808228569 conn(0x7f767c0b7e80 msgr2=0x7f767c0b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- 172.21.15.167:0/808228569 shutdown_connections 2024-09-13T17:21:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- 172.21.15.167:0/808228569 wait complete. 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 Processor -- start 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- start start 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f767c06bde0 0x7f767c13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f767c0a0b60 0x7f767c1de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0b6690 0x7f767c13a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c141940 con 0x7f767c0b6690 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c143010 con 0x7f767c0a0b60 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c140fa0 con 0x7f767c06bde0 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0b6690 0x7f767c13a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0b6690 0x7f767c13a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56370/0 (socket says 172.21.15.167:56370) 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 -- 172.21.15.167:0/1091885987 learned_addr learned my addr 172.21.15.167:0/1091885987 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 -- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f767c06bde0 msgr2=0x7f767c13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f767c06bde0 0x7f767c13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 -- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f767c0a0b60 msgr2=0x7f767c1de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f767b7fe640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f767c0a0b60 0x7f767c1de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f767c0a0b60 0x7f767c1de3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 -- 172.21.15.167:0/1091885987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c009420 con 0x7f767c0b6690 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f767b7fe640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f767c0a0b60 0x7f767c1de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7680a05640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0b6690 0x7f767c13a5e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7674007e40 tx=0x7f767400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7678ff9640 1 -- 172.21.15.167:0/1091885987 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674014620 con 0x7f767c0b6690 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7678ff9640 1 -- 172.21.15.167:0/1091885987 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767400ee90 con 0x7f767c0b6690 2024-09-13T17:21:01.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c141280 con 0x7f767c0b6690 2024-09-13T17:21:01.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7678ff9640 1 -- 172.21.15.167:0/1091885987 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740149e0 con 0x7f767c0b6690 2024-09-13T17:21:01.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.098+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c141d60 con 0x7f767c0b6690 2024-09-13T17:21:01.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.102+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c144d40 con 0x7f767c0b6690 2024-09-13T17:21:01.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.102+0000 7f7678ff9640 1 -- 172.21.15.167:0/1091885987 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7674014b40 con 0x7f767c0b6690 2024-09-13T17:21:01.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.102+0000 7f7678ff9640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7668066690 0x7f7668068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.102+0000 7f7678ff9640 1 -- 172.21.15.167:0/1091885987 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7674084da0 con 0x7f767c0b6690 2024-09-13T17:21:01.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.102+0000 7f767bfff640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7668066690 0x7f7668068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.102+0000 7f767bfff640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7668066690 0x7f7668068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ad000 tx=0x7f766c004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.106+0000 7f7678ff9640 1 -- 172.21.15.167:0/1091885987 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7674051eb0 con 0x7f767c0b6690 2024-09-13T17:21:01.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f767c141a80 con 0x7f767c0b6690 2024-09-13T17:21:01.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7678ff9640 1 -- 172.21.15.167:0/1091885987 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f767c141a80 con 0x7f767c0b6690 2024-09-13T17:21:01.269 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:01.269 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7668066690 msgr2=0x7f7668068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7668066690 0x7f7668068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ad000 tx=0x7f766c004740 comp rx=0 tx=0).stop 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0b6690 msgr2=0x7f767c13a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0b6690 0x7f767c13a5e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7674007e40 tx=0x7f767400e4b0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 shutdown_connections 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7668066690 0x7f7668068b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0b6690 0x7f767c13a5e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f767c0a0b60 0x7f767c1de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 --2- 172.21.15.167:0/1091885987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f767c06bde0 0x7f767c13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.266+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 >> 172.21.15.167:0/1091885987 conn(0x7f767c0b7e80 msgr2=0x7f767c0b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:01.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.270+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 shutdown_connections 2024-09-13T17:21:01.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.270+0000 7f7682468640 1 -- 172.21.15.167:0/1091885987 wait complete. 2024-09-13T17:21:01.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:20:49.286397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:20:49.932204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:20:52.990224+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:21:01.288 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:21:01.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.406+0000 7f82feb73640 1 Processor -- start 2024-09-13T17:21:01.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.406+0000 7f82feb73640 1 -- start start 2024-09-13T17:21:01.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82feb73640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f82f813faf0 0x7f82f8151200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82feb73640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f8146880 con 0x7f82f80aeca0 2024-09-13T17:21:01.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82feb73640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f80af1e0 con 0x7f82f80b56b0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82feb73640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f8149300 con 0x7f82f813faf0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f82f80aeca0 0x7f82f813f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44954/0 (socket says 172.21.15.167:44954) 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f7fff640 1 -- 172.21.15.167:0/274259073 learned_addr learned my addr 172.21.15.167:0/274259073 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 --2- 172.21.15.167:0/274259073 >> v2:172.21.15.190:3300/0 conn(0x7f82f813faf0 0x7f82f8151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245055729 0 0) 0x7f82f8146880 con 0x7f82f80aeca0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e0003530 con 0x7f82f80aeca0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948941424 0 0) 0x7f82e0003530 con 0x7f82f80aeca0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 >> v2:172.21.15.190:3300/0 conn(0x7f82f813faf0 msgr2=0x7f82f8151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 --2- 172.21.15.167:0/274259073 >> v2:172.21.15.190:3300/0 conn(0x7f82f813faf0 0x7f82f8151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 >> v1:172.21.15.190:6789/0 conn(0x7f82f80b56b0 legacy=0x7f82f8149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80b5a90 con 0x7f82f80aeca0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f82ec001680 con 0x7f82f80aeca0 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 >> v1:172.21.15.167:6789/0 conn(0x7f82f80aeca0 legacy=0x7f82f813f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e0003980 0x7f82e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e00047d0 0x7f82e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8149300 con 0x7f82e00052b0 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e000c180 con 0x7f82e0003980 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e000c340 con 0x7f82e00047d0 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 -- 172.21.15.167:0/274259073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e00047d0 msgr2=0x7f82e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82e00047d0 0x7f82e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 -- 172.21.15.167:0/274259073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e0003980 msgr2=0x7f82e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fc90f640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e0003980 0x7f82e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82e0003980 0x7f82e0003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 -- 172.21.15.167:0/274259073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0003530 con 0x7f82e00052b0 2024-09-13T17:21:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 -- 172.21.15.167:0/274259073 reap_dead start 2024-09-13T17:21:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82fd110640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82e000b990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f82f80b3080 tx=0x7f82e801c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335eb996d25aa2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80af070 con 0x7f82e00052b0 2024-09-13T17:21:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e80ab430 con 0x7f82e00052b0 2024-09-13T17:21:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.410+0000 7f82f77fe640 1 -- 172.21.15.167:0/274259073 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ab7e0 con 0x7f82e00052b0 2024-09-13T17:21:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/274259073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 msgr2=0x7f82e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82e000b990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f82f80b3080 tx=0x7f82e801c620 comp rx=0 tx=0).stop 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/274259073 shutdown_connections 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 --2- 172.21.15.167:0/274259073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82e000b990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/274259073 >> 172.21.15.167:0/274259073 conn(0x7f82f80b8840 msgr2=0x7f82f80b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/274259073 shutdown_connections 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/274259073 wait complete. 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 Processor -- start 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- start start 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82f80b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8070e10 0x7f82f8146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82f806f670 0x7f82f806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f809dcb0 con 0x7f82e00052b0 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8071700 con 0x7f82f8070e10 2024-09-13T17:21:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8145650 con 0x7f82f806f670 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82f80b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82f80b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56394/0 (socket says 172.21.15.167:56394) 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 -- 172.21.15.167:0/3046480957 learned_addr learned my addr 172.21.15.167:0/3046480957 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82f7fff640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8070e10 0x7f82f8146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 -- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82f806f670 msgr2=0x7f82f806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fd110640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82f806f670 0x7f82f806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82f806f670 0x7f82f806faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 -- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8070e10 msgr2=0x7f82f8146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8070e10 0x7f82f8146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 -- 172.21.15.167:0/3046480957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8071420 con 0x7f82e00052b0 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82f7fff640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8070e10 0x7f82f8146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82fc90f640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82f80b32f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f82f000d910 tx=0x7f82f000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82f57fa640 1 -- 172.21.15.167:0/3046480957 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0003db0 con 0x7f82e00052b0 2024-09-13T17:21:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82f57fa640 1 -- 172.21.15.167:0/3046480957 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000b6b0 con 0x7f82e00052b0 2024-09-13T17:21:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8144690 con 0x7f82e00052b0 2024-09-13T17:21:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82f57fa640 1 -- 172.21.15.167:0/3046480957 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000ba40 con 0x7f82e00052b0 2024-09-13T17:21:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f81436e0 con 0x7f82e00052b0 2024-09-13T17:21:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.414+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f80ae390 con 0x7f82e00052b0 2024-09-13T17:21:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.418+0000 7f82f57fa640 1 -- 172.21.15.167:0/3046480957 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82f000bba0 con 0x7f82e00052b0 2024-09-13T17:21:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.418+0000 7f82f57fa640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f82e40666c0 0x7f82e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.418+0000 7f82f57fa640 1 -- 172.21.15.167:0/3046480957 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82f0084640 con 0x7f82e00052b0 2024-09-13T17:21:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.418+0000 7f82f7fff640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f82e40666c0 0x7f82e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.418+0000 7f82f7fff640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f82e40666c0 0x7f82e4068b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0011f0 tx=0x7f82ec00c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.422+0000 7f82f57fa640 1 -- 172.21.15.167:0/3046480957 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82f00516c0 con 0x7f82e00052b0 2024-09-13T17:21:01.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.582+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82f80ae7a0 con 0x7f82e00052b0 2024-09-13T17:21:01.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.582+0000 7f82f57fa640 1 -- 172.21.15.167:0/3046480957 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82f0054ce0 con 0x7f82e00052b0 2024-09-13T17:21:01.587 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:21:01.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f82e40666c0 msgr2=0x7f82e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f82e40666c0 0x7f82e4068b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0011f0 tx=0x7f82ec00c040 comp rx=0 tx=0).stop 2024-09-13T17:21:01.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 msgr2=0x7f82f80b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82f80b32f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f82f000d910 tx=0x7f82f000ddd0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 shutdown_connections 2024-09-13T17:21:01.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f82e40666c0 0x7f82e4068b80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82f806f670 0x7f82f806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8070e10 0x7f82f8146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 --2- 172.21.15.167:0/3046480957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e00052b0 0x7f82f80b32f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 >> 172.21.15.167:0/3046480957 conn(0x7f82f80b8840 msgr2=0x7f82f806a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:01.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 shutdown_connections 2024-09-13T17:21:01.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.586+0000 7f82feb73640 1 -- 172.21.15.167:0/3046480957 wait complete. 2024-09-13T17:21:01.606 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:21:01.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8df725640 1 Processor -- start 2024-09-13T17:21:01.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8df725640 1 -- start start 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8df725640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 0x7fc8d809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8df725640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc8d809c600 0x7fc8d806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8df725640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80b5ea0 con 0x7fc8d806c940 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8df725640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d809b950 con 0x7fc8d809c600 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8df725640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d806aa60 con 0x7fc8d806a1e0 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc8d806c940 0x7fc8d8146f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44962/0 (socket says 172.21.15.167:44962) 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 -- 172.21.15.167:0/2940799996 learned_addr learned my addr 172.21.15.167:0/2940799996 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79277140 0 0) 0x7fc8d80b5ea0 con 0x7fc8d806c940 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8dccc0640 1 --2- 172.21.15.167:0/2940799996 >> v2:172.21.15.190:3300/0 conn(0x7fc8d809c600 0x7fc8d806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8dd4c1640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 0x7fc8d809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c4003530 con 0x7fc8d806c940 2024-09-13T17:21:01.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 149392734 0 0) 0x7fc8c4003530 con 0x7fc8d806c940 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 msgr2=0x7fc8d809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 0x7fc8d809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 >> v2:172.21.15.190:3300/0 conn(0x7fc8d809c600 msgr2=0x7fc8d806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 --2- 172.21.15.167:0/2940799996 >> v2:172.21.15.190:3300/0 conn(0x7fc8d809c600 0x7fc8d806c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80b60f0 con 0x7fc8d806c940 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fc8d0001a00 con 0x7fc8d806c940 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8dccc0640 1 --2- 172.21.15.167:0/2940799996 >> v2:172.21.15.190:3300/0 conn(0x7fc8d809c600 0x7fc8d806c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 >> v1:172.21.15.167:6789/0 conn(0x7fc8d806c940 legacy=0x7fc8d8146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8c4003980 0x7fc8c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 0x7fc8c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d809b950 con 0x7fc8c4004d10 2024-09-13T17:21:01.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d806aa60 con 0x7fc8c4003980 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c400b990 con 0x7fc8d806a1e0 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8dd4c1640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8c4003980 0x7fc8c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8dccc0640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 0x7fc8c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 -- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 msgr2=0x7fc8c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d806a1e0 0x7fc8c40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 -- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8c4003980 msgr2=0x7fc8c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8c4003980 0x7fc8c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8ddcc2640 1 -- 172.21.15.167:0/2940799996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4003530 con 0x7fc8c4004d10 2024-09-13T17:21:01.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.718+0000 7fc8dd4c1640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8c4003980 0x7fc8c4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:01.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8ddcc2640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8c4005190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000a860 tx=0x7fc8d001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185adc3608f3a43e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00ad630 con 0x7fc8c4004d10 2024-09-13T17:21:01.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d00a8070 con 0x7fc8c4004d10 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8cffff640 1 -- 172.21.15.167:0/2940799996 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00ad9d0 con 0x7fc8c4004d10 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- 172.21.15.167:0/2940799996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 msgr2=0x7fc8c4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 --2- 172.21.15.167:0/2940799996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8c4005190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000a860 tx=0x7fc8d001d340 comp rx=0 tx=0).stop 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8ddcc2640 1 -- 172.21.15.167:0/2940799996 reap_dead start 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- 172.21.15.167:0/2940799996 shutdown_connections 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- 172.21.15.167:0/2940799996 >> 172.21.15.167:0/2940799996 conn(0x7fc8d806b9d0 msgr2=0x7fc8d80b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- 172.21.15.167:0/2940799996 shutdown_connections 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- 172.21.15.167:0/2940799996 wait complete. 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 Processor -- start 2024-09-13T17:21:01.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- start start 2024-09-13T17:21:01.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8d80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d80b54d0 0x7fc8d8141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d81dc260 0x7fc8d81dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b5930 con 0x7fc8c4004d10 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b34b0 con 0x7fc8d81dc260 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b4a70 con 0x7fc8d80b54d0 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8d80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8d80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56416/0 (socket says 172.21.15.167:56416) 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 -- 172.21.15.167:0/975032472 learned_addr learned my addr 172.21.15.167:0/975032472 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dccc0640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d80b54d0 0x7fc8d8141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8ddcc2640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d81dc260 0x7fc8d81dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 -- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d80b54d0 msgr2=0x7fc8d8141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d80b54d0 0x7fc8d8141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 -- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d81dc260 msgr2=0x7fc8d81dc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d81dc260 0x7fc8d81dc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 -- 172.21.15.167:0/975032472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80b2e60 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dccc0640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d80b54d0 0x7fc8d8141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8dd4c1640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8d80b3940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4010890 tx=0x7fc8d4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8cdffb640 1 -- 172.21.15.167:0/975032472 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004220 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8cdffb640 1 -- 172.21.15.167:0/975032472 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4004380 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8cdffb640 1 -- 172.21.15.167:0/975032472 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400eb20 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d80b3140 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.722+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d80b2b10 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.726+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d8098bc0 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.726+0000 7fc8cdffb640 1 -- 172.21.15.167:0/975032472 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8d400ec80 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.726+0000 7fc8cdffb640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc8bc0666c0 0x7fc8bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.726+0000 7fc8cdffb640 1 -- 172.21.15.167:0/975032472 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc8d4084710 con 0x7fc8c4004d10 2024-09-13T17:21:01.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.726+0000 7fc8dccc0640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc8bc0666c0 0x7fc8bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:01.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.726+0000 7fc8dccc0640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc8bc0666c0 0x7fc8bc068b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8146b40 tx=0x7fc8c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.730+0000 7fc8cdffb640 1 -- 172.21.15.167:0/975032472 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8d4051770 con 0x7fc8c4004d10 2024-09-13T17:21:01.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.886+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8d8071660 con 0x7fc8c4004d10 2024-09-13T17:21:01.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8cdffb640 1 -- 172.21.15.167:0/975032472 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8d4054d90 con 0x7fc8c4004d10 2024-09-13T17:21:01.892 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:01.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc8bc0666c0 msgr2=0x7fc8bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc8bc0666c0 0x7fc8bc068b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8146b40 tx=0x7fc8c8008040 comp rx=0 tx=0).stop 2024-09-13T17:21:01.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 msgr2=0x7fc8d80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:01.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8d80b3940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4010890 tx=0x7fc8d4010d50 comp rx=0 tx=0).stop 2024-09-13T17:21:01.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 shutdown_connections 2024-09-13T17:21:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc8bc0666c0 0x7fc8bc068b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d81dc260 0x7fc8d81dc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d80b54d0 0x7fc8d8141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 --2- 172.21.15.167:0/975032472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c4004d10 0x7fc8d80b3940 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 >> 172.21.15.167:0/975032472 conn(0x7fc8d806b9d0 msgr2=0x7fc8d8070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 shutdown_connections 2024-09-13T17:21:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:01.890+0000 7fc8df725640 1 -- 172.21.15.167:0/975032472 wait complete. 2024-09-13T17:21:01.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:21:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.030+0000 7f5d3eb46640 1 Processor -- start 2024-09-13T17:21:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.030+0000 7f5d3eb46640 1 -- start start 2024-09-13T17:21:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3eb46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5d38146520 0x7f5d380b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3eb46640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d3806b990 0x7f5d381501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3eb46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3806b4e0 con 0x7f5d380b70d0 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3eb46640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3806a6d0 con 0x7f5d3806b990 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3eb46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380b7ca0 con 0x7f5d38146520 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d3806b990 0x7f5d381501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d3806b990 0x7f5d381501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56420/0 (socket says 172.21.15.167:56420) 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 -- 172.21.15.167:0/3536849537 learned_addr learned my addr 172.21.15.167:0/3536849537 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3c8e2640 1 --2- 172.21.15.167:0/3536849537 >> v2:172.21.15.190:3300/0 conn(0x7f5d38146520 0x7f5d380b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 -- 172.21.15.167:0/3536849537 >> v2:172.21.15.190:3300/0 conn(0x7f5d38146520 msgr2=0x7f5d380b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 --2- 172.21.15.167:0/3536849537 >> v2:172.21.15.190:3300/0 conn(0x7f5d38146520 0x7f5d380b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 -- 172.21.15.167:0/3536849537 >> v1:172.21.15.190:6789/0 conn(0x7f5d380b70d0 legacy=0x7f5d380b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 -- 172.21.15.167:0/3536849537 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d380bc2f0 con 0x7f5d3806b990 2024-09-13T17:21:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d3d0e3640 1 --2- 172.21.15.167:0/3536849537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3806b990 0x7f5d381501b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d380bc1d0 tx=0x7f5d3001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174b7d77dd07063c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d377fe640 1 -- 172.21.15.167:0/3536849537 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300a5670 con 0x7f5d3806b990 2024-09-13T17:21:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d377fe640 1 -- 172.21.15.167:0/3536849537 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d300a57d0 con 0x7f5d3806b990 2024-09-13T17:21:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.034+0000 7f5d377fe640 1 -- 172.21.15.167:0/3536849537 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300a5b60 con 0x7f5d3806b990 2024-09-13T17:21:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3536849537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3806b990 msgr2=0x7f5d381501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3536849537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3806b990 0x7f5d381501b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d380bc1d0 tx=0x7f5d3001c9b0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3536849537 shutdown_connections 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3536849537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3806b990 0x7f5d381501b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3536849537 >> v2:172.21.15.190:3300/0 conn(0x7f5d38146520 0x7f5d380b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3536849537 >> 172.21.15.167:0/3536849537 conn(0x7f5d380bb440 msgr2=0x7f5d380bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3536849537 shutdown_connections 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3536849537 wait complete. 2024-09-13T17:21:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 Processor -- start 2024-09-13T17:21:02.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- start start 2024-09-13T17:21:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d3806b990 0x7f5d3813a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d380b70d0 0x7f5d3809f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d38146520 0x7f5d380b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381df300 con 0x7f5d380b70d0 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381decb0 con 0x7f5d38146520 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381def90 con 0x7f5d3806b990 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d380b70d0 0x7f5d3809f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d380b70d0 0x7f5d3809f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56432/0 (socket says 172.21.15.167:56432) 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 -- 172.21.15.167:0/3063615553 learned_addr learned my addr 172.21.15.167:0/3063615553 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3d0e3640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d38146520 0x7f5d380b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3c8e2640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d3806b990 0x7f5d3813a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 -- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d3806b990 msgr2=0x7f5d3813a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d3806b990 0x7f5d3813a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 -- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d38146520 msgr2=0x7f5d380b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d38146520 0x7f5d380b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 -- 172.21.15.167:0/3063615553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30009b30 con 0x7f5d380b70d0 2024-09-13T17:21:02.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d37fff640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d380b70d0 0x7f5d3809f770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c450 tx=0x7f5d2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d357fa640 1 -- 172.21.15.167:0/3063615553 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28012830 con 0x7f5d380b70d0 2024-09-13T17:21:02.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d357fa640 1 -- 172.21.15.167:0/3063615553 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d280129b0 con 0x7f5d380b70d0 2024-09-13T17:21:02.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d357fa640 1 -- 172.21.15.167:0/3063615553 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28012d60 con 0x7f5d380b70d0 2024-09-13T17:21:02.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d380a0420 con 0x7f5d380b70d0 2024-09-13T17:21:02.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.038+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d381de760 con 0x7f5d380b70d0 2024-09-13T17:21:02.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.042+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d381df150 con 0x7f5d380b70d0 2024-09-13T17:21:02.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.042+0000 7f5d357fa640 1 -- 172.21.15.167:0/3063615553 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d2801c460 con 0x7f5d380b70d0 2024-09-13T17:21:02.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.042+0000 7f5d357fa640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5d240666c0 0x7f5d24068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.042+0000 7f5d357fa640 1 -- 172.21.15.167:0/3063615553 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d28084260 con 0x7f5d380b70d0 2024-09-13T17:21:02.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.042+0000 7f5d3c8e2640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5d240666c0 0x7f5d24068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.042+0000 7f5d3c8e2640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5d240666c0 0x7f5d24068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00b930 tx=0x7f5d2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.046+0000 7f5d357fa640 1 -- 172.21.15.167:0/3063615553 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5d28051370 con 0x7f5d380b70d0 2024-09-13T17:21:02.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.206+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d380b5870 con 0x7f5d380b70d0 2024-09-13T17:21:02.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.206+0000 7f5d357fa640 1 -- 172.21.15.167:0/3063615553 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d28054990 con 0x7f5d380b70d0 2024-09-13T17:21:02.209 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5d240666c0 msgr2=0x7f5d24068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5d240666c0 0x7f5d24068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00b930 tx=0x7f5d2c008040 comp rx=0 tx=0).stop 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d380b70d0 msgr2=0x7f5d3809f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d380b70d0 0x7f5d3809f770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c450 tx=0x7f5d2800c910 comp rx=0 tx=0).stop 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 shutdown_connections 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5d240666c0 0x7f5d24068b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d38146520 0x7f5d380b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d380b70d0 0x7f5d3809f770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 --2- 172.21.15.167:0/3063615553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5d3806b990 0x7f5d3813a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 >> 172.21.15.167:0/3063615553 conn(0x7f5d380bb440 msgr2=0x7f5d38143880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:02.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 shutdown_connections 2024-09-13T17:21:02.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.210+0000 7f5d3eb46640 1 -- 172.21.15.167:0/3063615553 wait complete. 2024-09-13T17:21:02.228 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:21:02.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.338+0000 7fbd672f4640 1 Processor -- start 2024-09-13T17:21:02.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.338+0000 7fbd672f4640 1 -- start start 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd672f4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd60098a40 0x7fbd60143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd672f4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 0x7fbd6014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd672f4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd60144490 con 0x7fbd600b3530 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd672f4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6009b090 con 0x7fbd60098a40 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd672f4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6009d410 con 0x7fbd60143fe0 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd60098a40 0x7fbd60143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd60098a40 0x7fbd60143aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56446/0 (socket says 172.21.15.167:56446) 2024-09-13T17:21:02.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 -- 172.21.15.167:0/1125696924 learned_addr learned my addr 172.21.15.167:0/1125696924 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:02.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd65891640 1 --2- 172.21.15.167:0/1125696924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 0x7fbd6014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 -- 172.21.15.167:0/1125696924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 msgr2=0x7fbd6014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 --2- 172.21.15.167:0/1125696924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 0x7fbd6014dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 -- 172.21.15.167:0/1125696924 >> v1:172.21.15.190:6789/0 conn(0x7fbd600b3530 legacy=0x7fbd6009cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 -- 172.21.15.167:0/1125696924 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600b3910 con 0x7fbd60098a40 2024-09-13T17:21:02.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.342+0000 7fbd6488f640 1 --2- 172.21.15.167:0/1125696924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd60098a40 0x7fbd60143aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009870 tx=0x7fbd5001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fedab05194f5b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd57fff640 1 -- 172.21.15.167:0/1125696924 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500aa640 con 0x7fbd60098a40 2024-09-13T17:21:02.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd57fff640 1 -- 172.21.15.167:0/1125696924 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd500aa7a0 con 0x7fbd60098a40 2024-09-13T17:21:02.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd57fff640 1 -- 172.21.15.167:0/1125696924 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500aab30 con 0x7fbd60098a40 2024-09-13T17:21:02.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- 172.21.15.167:0/1125696924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd60098a40 msgr2=0x7fbd60143aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 --2- 172.21.15.167:0/1125696924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd60098a40 0x7fbd60143aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009870 tx=0x7fbd5001c520 comp rx=0 tx=0).stop 2024-09-13T17:21:02.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- 172.21.15.167:0/1125696924 shutdown_connections 2024-09-13T17:21:02.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 --2- 172.21.15.167:0/1125696924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 0x7fbd6014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 --2- 172.21.15.167:0/1125696924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd60098a40 0x7fbd60143aa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- 172.21.15.167:0/1125696924 >> 172.21.15.167:0/1125696924 conn(0x7fbd600b3b50 msgr2=0x7fbd600b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:02.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- 172.21.15.167:0/1125696924 shutdown_connections 2024-09-13T17:21:02.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- 172.21.15.167:0/1125696924 wait complete. 2024-09-13T17:21:02.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 Processor -- start 2024-09-13T17:21:02.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- start start 2024-09-13T17:21:02.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd600b3530 0x7fbd60070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 0x7fbd600b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd600afdb0 0x7fbd6013a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6013f300 con 0x7fbd600b3530 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b13b0 con 0x7fbd600afdb0 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6013e210 con 0x7fbd60143fe0 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd600b3530 0x7fbd60070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd600b3530 0x7fbd60070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56450/0 (socket says 172.21.15.167:56450) 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 -- 172.21.15.167:0/3048022118 learned_addr learned my addr 172.21.15.167:0/3048022118 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 -- 172.21.15.167:0/3048022118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 msgr2=0x7fbd600b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 0x7fbd600b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 -- 172.21.15.167:0/3048022118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd600afdb0 msgr2=0x7fbd6013a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd600afdb0 0x7fbd6013a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 -- 172.21.15.167:0/3048022118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500094d0 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd65090640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd600b3530 0x7fbd60070740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c450 tx=0x7fbd5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd55ffb640 1 -- 172.21.15.167:0/3048022118 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c012830 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd55ffb640 1 -- 172.21.15.167:0/3048022118 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c012990 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd60071390 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd55ffb640 1 -- 172.21.15.167:0/3048022118 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c012d40 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.346+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6013f7c0 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.350+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600b0220 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.350+0000 7fbd55ffb640 1 -- 172.21.15.167:0/3048022118 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd5c01c460 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.350+0000 7fbd55ffb640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd44066690 0x7fbd44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.350+0000 7fbd55ffb640 1 -- 172.21.15.167:0/3048022118 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd5c0842d0 con 0x7fbd600b3530 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.350+0000 7fbd6488f640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd44066690 0x7fbd44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.350+0000 7fbd6488f640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd44066690 0x7fbd44068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd500ae000 tx=0x7fbd50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.354+0000 7fbd55ffb640 1 -- 172.21.15.167:0/3048022118 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd600b0220 con 0x7fbd600b3530 2024-09-13T17:21:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.498+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbd600b0220 con 0x7fbd600b3530 2024-09-13T17:21:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd55ffb640 1 -- 172.21.15.167:0/3048022118 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd600b0220 con 0x7fbd600b3530 2024-09-13T17:21:02.504 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:02.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd44066690 msgr2=0x7fbd44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd44066690 0x7fbd44068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd500ae000 tx=0x7fbd50008040 comp rx=0 tx=0).stop 2024-09-13T17:21:02.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd600b3530 msgr2=0x7fbd60070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd600b3530 0x7fbd60070740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c450 tx=0x7fbd5c00c910 comp rx=0 tx=0).stop 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 shutdown_connections 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbd44066690 0x7fbd44068b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd600afdb0 0x7fbd6013a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd60143fe0 0x7fbd600b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 --2- 172.21.15.167:0/3048022118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd600b3530 0x7fbd60070740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 >> 172.21.15.167:0/3048022118 conn(0x7fbd600b3b50 msgr2=0x7fbd6006b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 shutdown_connections 2024-09-13T17:21:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.502+0000 7fbd672f4640 1 -- 172.21.15.167:0/3048022118 wait complete. 2024-09-13T17:21:02.522 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:21:02.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc7acc640 1 Processor -- start 2024-09-13T17:21:02.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc7acc640 1 -- start start 2024-09-13T17:21:02.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc7acc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 0x7f6fc014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc7acc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc00ad2d0 con 0x7f6fc0071d00 2024-09-13T17:21:02.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc7acc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc00ae000 con 0x7f6fc00aca80 2024-09-13T17:21:02.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc7acc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00b2c00 con 0x7f6fc00ace60 2024-09-13T17:21:02.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6fc0071d00 0x7f6fc009cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44968/0 (socket says 172.21.15.167:44968) 2024-09-13T17:21:02.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 -- 172.21.15.167:0/569510234 learned_addr learned my addr 172.21.15.167:0/569510234 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:02.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283156185 0 0) 0x7f6fc00ad2d0 con 0x7f6fc0071d00 2024-09-13T17:21:02.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc6069640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 0x7f6fc014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fac003530 con 0x7f6fc0071d00 2024-09-13T17:21:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4091457087 0 0) 0x7f6fac003530 con 0x7f6fc0071d00 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 msgr2=0x7f6fc014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 0x7f6fc014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 >> v1:172.21.15.190:6789/0 conn(0x7f6fc00aca80 legacy=0x7f6fc00b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0145cb0 con 0x7f6fc0071d00 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f6fb0001680 con 0x7f6fc0071d00 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 >> v1:172.21.15.167:6789/0 conn(0x7f6fc0071d00 legacy=0x7f6fc009cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 0x7f6fac0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fac004d10 0x7f6fac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00b2c00 con 0x7f6fac003f50 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac00dd60 con 0x7f6fac004d10 2024-09-13T17:21:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac00df20 con 0x7f6fc00ace60 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5868640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 0x7f6fac0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc6069640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fac004d10 0x7f6fac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 -- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 msgr2=0x7f6fac0039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00ace60 0x7f6fac0039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 -- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fac004d10 msgr2=0x7f6fac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fac004d10 0x7f6fac005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.630+0000 7f6fc5067640 1 -- 172.21.15.167:0/569510234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac003530 con 0x7f6fac003f50 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5067640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fac0047d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c240 tx=0x7f6fb001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4c823972c1d559 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0005ae0 con 0x7f6fac003f50 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0005c40 con 0x7f6fac003f50 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc4866640 1 -- 172.21.15.167:0/569510234 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00a5a50 con 0x7f6fac003f50 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- 172.21.15.167:0/569510234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 msgr2=0x7f6fac0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 --2- 172.21.15.167:0/569510234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fac0047d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c240 tx=0x7f6fb001cc30 comp rx=0 tx=0).stop 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc6069640 1 -- 172.21.15.167:0/569510234 reap_dead start 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- 172.21.15.167:0/569510234 shutdown_connections 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- 172.21.15.167:0/569510234 >> 172.21.15.167:0/569510234 conn(0x7f6fc00b3b50 msgr2=0x7f6fc00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- 172.21.15.167:0/569510234 shutdown_connections 2024-09-13T17:21:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- 172.21.15.167:0/569510234 wait complete. 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 Processor -- start 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- start start 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fc00af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fc0141480 0x7f6fc00af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00b0d80 0x7f6fc01dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00af600 con 0x7f6fac003f50 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00ae990 con 0x7f6fc0141480 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc013bfd0 con 0x7f6fc00b0d80 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fc00af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fc00af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56470/0 (socket says 172.21.15.167:56470) 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 -- 172.21.15.167:0/2837484820 learned_addr learned my addr 172.21.15.167:0/2837484820 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 -- 172.21.15.167:0/2837484820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00b0d80 msgr2=0x7f6fc01dcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00b0d80 0x7f6fc01dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 -- 172.21.15.167:0/2837484820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fc0141480 msgr2=0x7f6fc00af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5067640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fc0141480 0x7f6fc00af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fc0141480 0x7f6fc00af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 -- 172.21.15.167:0/2837484820 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc014bcc0 con 0x7f6fac003f50 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc5868640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fc00af9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00e500 tx=0x7f6fbc00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fb67fc640 1 -- 172.21.15.167:0/2837484820 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0052e0 con 0x7f6fac003f50 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fb67fc640 1 -- 172.21.15.167:0/2837484820 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc005440 con 0x7f6fac003f50 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc00aec30 con 0x7f6fac003f50 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fb67fc640 1 -- 172.21.15.167:0/2837484820 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc003820 con 0x7f6fac003f50 2024-09-13T17:21:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.634+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc0143310 con 0x7f6fac003f50 2024-09-13T17:21:02.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.638+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc009cb40 con 0x7f6fac003f50 2024-09-13T17:21:02.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.638+0000 7f6fb67fc640 1 -- 172.21.15.167:0/2837484820 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fbc003980 con 0x7f6fac003f50 2024-09-13T17:21:02.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.638+0000 7f6fb67fc640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6fa4066690 0x7f6fa4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.638+0000 7f6fc5067640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6fa4066690 0x7f6fa4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.638+0000 7f6fb67fc640 1 -- 172.21.15.167:0/2837484820 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fbc084150 con 0x7f6fac003f50 2024-09-13T17:21:02.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.638+0000 7f6fc5067640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6fa4066690 0x7f6fa4068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ab000 tx=0x7f6fb00a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.642+0000 7f6fb67fc640 1 -- 172.21.15.167:0/2837484820 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fbc0511e0 con 0x7f6fac003f50 2024-09-13T17:21:02.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.806+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6fc00ada40 con 0x7f6fac003f50 2024-09-13T17:21:02.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.806+0000 7f6fb67fc640 1 -- 172.21.15.167:0/2837484820 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6fbc054800 con 0x7f6fac003f50 2024-09-13T17:21:02.810 INFO:teuthology.orchestra.run.smithi167.stderr:listed 0 entries 2024-09-13T17:21:02.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6fa4066690 msgr2=0x7f6fa4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6fa4066690 0x7f6fa4068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ab000 tx=0x7f6fb00a7070 comp rx=0 tx=0).stop 2024-09-13T17:21:02.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 msgr2=0x7f6fc00af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fc00af9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00e500 tx=0x7f6fbc00e9c0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 shutdown_connections 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6fa4066690 0x7f6fa4068b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fc00b0d80 0x7f6fc01dcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fc0141480 0x7f6fc00af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 --2- 172.21.15.167:0/2837484820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fac003f50 0x7f6fc00af9d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 >> 172.21.15.167:0/2837484820 conn(0x7f6fc00b3b50 msgr2=0x7f6fc009aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 shutdown_connections 2024-09-13T17:21:02.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.810+0000 7f6fc7acc640 1 -- 172.21.15.167:0/2837484820 wait complete. 2024-09-13T17:21:02.828 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:21:02.828 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:21:02.833 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:02.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.986+0000 7fa897a5f640 1 Processor -- start 2024-09-13T17:21:02.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.986+0000 7fa897a5f640 1 -- start start 2024-09-13T17:21:02.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa897a5f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa89006a1e0 0x7fa8900aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa897a5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8900b4900 0x7fa89013fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa897a5f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89006a5c0 con 0x7fa8900af0d0 2024-09-13T17:21:02.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa897a5f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890071480 con 0x7fa89006a1e0 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa897a5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900b3e70 con 0x7fa8900b4900 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa8957fb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa89006a1e0 0x7fa8900aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa894ffa640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa8900af0d0 0x7fa89013f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44972/0 (socket says 172.21.15.167:44972) 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa894ffa640 1 -- 172.21.15.167:0/359826596 learned_addr learned my addr 172.21.15.167:0/359826596 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa895ffc640 1 --2- 172.21.15.167:0/359826596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8900b4900 0x7fa89013fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa8957fb640 1 -- 172.21.15.167:0/359826596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8900b4900 msgr2=0x7fa89013fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa8957fb640 1 --2- 172.21.15.167:0/359826596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8900b4900 0x7fa89013fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa8957fb640 1 -- 172.21.15.167:0/359826596 >> v1:172.21.15.167:6789/0 conn(0x7fa8900af0d0 legacy=0x7fa89013f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa887fff640 1 -- 172.21.15.167:0/359826596 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388190144 0 0) 0x7fa89006a5c0 con 0x7fa8900af0d0 2024-09-13T17:21:02.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa8957fb640 1 -- 172.21.15.167:0/359826596 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900b4150 con 0x7fa89006a1e0 2024-09-13T17:21:02.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa8957fb640 1 --2- 172.21.15.167:0/359826596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa89006a1e0 0x7fa8900aeb90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0097c0 tx=0x7fa88c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f1c29a987ade0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:02.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa887fff640 1 -- 172.21.15.167:0/359826596 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0ac640 con 0x7fa89006a1e0 2024-09-13T17:21:02.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa887fff640 1 -- 172.21.15.167:0/359826596 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c0ac7a0 con 0x7fa89006a1e0 2024-09-13T17:21:02.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.990+0000 7fa887fff640 1 -- 172.21.15.167:0/359826596 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0acb30 con 0x7fa89006a1e0 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/359826596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa89006a1e0 msgr2=0x7fa8900aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 --2- 172.21.15.167:0/359826596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa89006a1e0 0x7fa8900aeb90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0097c0 tx=0x7fa88c01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/359826596 shutdown_connections 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 --2- 172.21.15.167:0/359826596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8900b4900 0x7fa89013fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 --2- 172.21.15.167:0/359826596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa89006a1e0 0x7fa8900aeb90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/359826596 >> 172.21.15.167:0/359826596 conn(0x7fa8900b8260 msgr2=0x7fa8900b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/359826596 shutdown_connections 2024-09-13T17:21:02.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/359826596 wait complete. 2024-09-13T17:21:02.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 Processor -- start 2024-09-13T17:21:02.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- start start 2024-09-13T17:21:02.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006a1e0 0x7fa8900b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8900b4900 0x7fa8901de2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8900b2260 0x7fa8901de830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900b13f0 con 0x7fa8900b4900 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8901dde10 con 0x7fa8900b2260 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900ab8c0 con 0x7fa89006a1e0 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8900b4900 0x7fa8901de2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8900b4900 0x7fa8901de2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56502/0 (socket says 172.21.15.167:56502) 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 -- 172.21.15.167:0/3939577047 learned_addr learned my addr 172.21.15.167:0/3939577047 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa8957fb640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006a1e0 0x7fa8900b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 -- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006a1e0 msgr2=0x7fa8900b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006a1e0 0x7fa8900b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 -- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8900b2260 msgr2=0x7fa8901de830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8900b2260 0x7fa8901de830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:02.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 -- 172.21.15.167:0/3939577047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009420 con 0x7fa8900b4900 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa8957fb640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006a1e0 0x7fa8900b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa894ffa640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8900b4900 0x7fa8901de2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8800011f0 tx=0x7fa88000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa885ffb640 1 -- 172.21.15.167:0/3939577047 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800074e0 con 0x7fa8900b4900 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa885ffb640 1 -- 172.21.15.167:0/3939577047 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa880007640 con 0x7fa8900b4900 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900b1650 con 0x7fa8900b4900 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa885ffb640 1 -- 172.21.15.167:0/3939577047 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880004a10 con 0x7fa8900b4900 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900afb90 con 0x7fa8900b4900 2024-09-13T17:21:03.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.994+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8901ddc70 con 0x7fa8900b4900 2024-09-13T17:21:03.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.998+0000 7fa885ffb640 1 -- 172.21.15.167:0/3939577047 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa880004b70 con 0x7fa8900b4900 2024-09-13T17:21:03.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.998+0000 7fa885ffb640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa874066690 0x7fa874068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.998+0000 7fa885ffb640 1 -- 172.21.15.167:0/3939577047 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8800839b0 con 0x7fa8900b4900 2024-09-13T17:21:03.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.998+0000 7fa8957fb640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa874066690 0x7fa874068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:02.998+0000 7fa8957fb640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa874066690 0x7fa874068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0ae000 tx=0x7fa88c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.002+0000 7fa885ffb640 1 -- 172.21.15.167:0/3939577047 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8901ddc70 con 0x7fa8900b4900 2024-09-13T17:21:03.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.162+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8901ddc70 con 0x7fa8900b4900 2024-09-13T17:21:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.162+0000 7fa885ffb640 1 -- 172.21.15.167:0/3939577047 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fa8901ddc70 con 0x7fa8900b4900 2024-09-13T17:21:03.167 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:03.167 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:03.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa874066690 msgr2=0x7fa874068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa874066690 0x7fa874068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0ae000 tx=0x7fa88c008040 comp rx=0 tx=0).stop 2024-09-13T17:21:03.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8900b4900 msgr2=0x7fa8901de2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8900b4900 0x7fa8901de2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8800011f0 tx=0x7fa88000c9b0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 shutdown_connections 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa874066690 0x7fa874068b50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8900b2260 0x7fa8901de830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8900b4900 0x7fa8901de2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 --2- 172.21.15.167:0/3939577047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa89006a1e0 0x7fa8900b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 >> 172.21.15.167:0/3939577047 conn(0x7fa8900b8260 msgr2=0x7fa89013ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 shutdown_connections 2024-09-13T17:21:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.166+0000 7fa897a5f640 1 -- 172.21.15.167:0/3939577047 wait complete. 2024-09-13T17:21:03.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:20:49.286397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:20:49.932204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:20:52.990224+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:21:03.187 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:21:03.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.298+0000 7fba54ae5640 1 Processor -- start 2024-09-13T17:21:03.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.298+0000 7fba54ae5640 1 -- start start 2024-09-13T17:21:03.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba54ae5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 0x7fba500b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba54ae5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fba500717d0 0x7fba5013ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba54ae5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5006edb0 con 0x7fba5013f350 2024-09-13T17:21:03.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba54ae5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba500710d0 con 0x7fba500717d0 2024-09-13T17:21:03.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba54ae5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5006f8d0 con 0x7fba5006f4f0 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fba5013f350 0x7fba501453a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44988/0 (socket says 172.21.15.167:44988) 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 -- 172.21.15.167:0/3214603311 learned_addr learned my addr 172.21.15.167:0/3214603311 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba47fff640 1 --2- 172.21.15.167:0/3214603311 >> v2:172.21.15.190:3300/0 conn(0x7fba500717d0 0x7fba5013ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4e59c640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 0x7fba500b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992657636 0 0) 0x7fba5006edb0 con 0x7fba5013f350 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c003530 con 0x7fba5013f350 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2700609235 0 0) 0x7fba3c003530 con 0x7fba5013f350 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 msgr2=0x7fba500b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 0x7fba500b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 >> v2:172.21.15.190:3300/0 conn(0x7fba500717d0 msgr2=0x7fba5013ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 --2- 172.21.15.167:0/3214603311 >> v2:172.21.15.190:3300/0 conn(0x7fba500717d0 0x7fba5013ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500ae7c0 con 0x7fba5013f350 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fba48001a00 con 0x7fba5013f350 2024-09-13T17:21:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 >> v1:172.21.15.167:6789/0 conn(0x7fba5013f350 legacy=0x7fba501453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 0x7fba3c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c003f00 0x7fba3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba3c004d10 0x7fba3c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5006f8d0 con 0x7fba3c004d10 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c00b990 con 0x7fba3c003f00 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c00bb00 con 0x7fba5006f4f0 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba3c004d10 0x7fba3c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4e59c640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 0x7fba3c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba47fff640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c003f00 0x7fba3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 -- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 msgr2=0x7fba3c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 0x7fba3c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 -- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c003f00 msgr2=0x7fba3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c003f00 0x7fba3c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4ed9d640 1 -- 172.21.15.167:0/3214603311 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c003530 con 0x7fba3c004d10 2024-09-13T17:21:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.302+0000 7fba4e59c640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba5006f4f0 0x7fba3c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba3c004d10 0x7fba3c005190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba4800a8d0 tx=0x7fba4801d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7319c78176c0fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480ad630 con 0x7fba3c004d10 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba480a8070 con 0x7fba3c004d10 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4dd9b640 1 -- 172.21.15.167:0/3214603311 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480ad9d0 con 0x7fba3c004d10 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- 172.21.15.167:0/3214603311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba3c004d10 msgr2=0x7fba3c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 --2- 172.21.15.167:0/3214603311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba3c004d10 0x7fba3c005190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba4800a8d0 tx=0x7fba4801d400 comp rx=0 tx=0).stop 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 -- 172.21.15.167:0/3214603311 reap_dead start 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- 172.21.15.167:0/3214603311 shutdown_connections 2024-09-13T17:21:03.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- 172.21.15.167:0/3214603311 >> 172.21.15.167:0/3214603311 conn(0x7fba50069f80 msgr2=0x7fba5006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- 172.21.15.167:0/3214603311 shutdown_connections 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- 172.21.15.167:0/3214603311 wait complete. 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 Processor -- start 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- start start 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c004d10 0x7fba50137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba50138420 0x7fba501dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba501dc2d0 0x7fba50131650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba50138ba0 con 0x7fba501dc2d0 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba50138e80 con 0x7fba50138420 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba50135370 con 0x7fba3c004d10 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba501dc2d0 0x7fba50131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba501dc2d0 0x7fba50131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56518/0 (socket says 172.21.15.167:56518) 2024-09-13T17:21:03.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 -- 172.21.15.167:0/1972981126 learned_addr learned my addr 172.21.15.167:0/1972981126 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba47fff640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba50138420 0x7fba501dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4e59c640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c004d10 0x7fba50137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 -- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c004d10 msgr2=0x7fba50137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c004d10 0x7fba50137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 -- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba50138420 msgr2=0x7fba501dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba50138420 0x7fba501dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 -- 172.21.15.167:0/1972981126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50136f40 con 0x7fba501dc2d0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba4ed9d640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba501dc2d0 0x7fba50131650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fba48001cc0 tx=0x7fba3c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba46ffd640 1 -- 172.21.15.167:0/1972981126 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48002010 con 0x7fba501dc2d0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba46ffd640 1 -- 172.21.15.167:0/1972981126 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba480017c0 con 0x7fba501dc2d0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba50137220 con 0x7fba501dc2d0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba46ffd640 1 -- 172.21.15.167:0/1972981126 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48004b70 con 0x7fba501dc2d0 2024-09-13T17:21:03.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.306+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba501dc750 con 0x7fba501dc2d0 2024-09-13T17:21:03.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.310+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba50067390 con 0x7fba501dc2d0 2024-09-13T17:21:03.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.310+0000 7fba46ffd640 1 -- 172.21.15.167:0/1972981126 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba480aa030 con 0x7fba501dc2d0 2024-09-13T17:21:03.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.310+0000 7fba46ffd640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fba30066690 0x7fba30068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.310+0000 7fba46ffd640 1 -- 172.21.15.167:0/1972981126 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba4811dff0 con 0x7fba501dc2d0 2024-09-13T17:21:03.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.310+0000 7fba4e59c640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fba30066690 0x7fba30068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.310+0000 7fba4e59c640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fba30066690 0x7fba30068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ac0 tx=0x7fba40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.314+0000 7fba46ffd640 1 -- 172.21.15.167:0/1972981126 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba480eec40 con 0x7fba501dc2d0 2024-09-13T17:21:03.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.462+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba500b3940 con 0x7fba501dc2d0 2024-09-13T17:21:03.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.462+0000 7fba46ffd640 1 -- 172.21.15.167:0/1972981126 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba480bc0a0 con 0x7fba501dc2d0 2024-09-13T17:21:03.466 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fba30066690 msgr2=0x7fba30068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fba30066690 0x7fba30068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ac0 tx=0x7fba40008040 comp rx=0 tx=0).stop 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba501dc2d0 msgr2=0x7fba50131650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba501dc2d0 0x7fba50131650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fba48001cc0 tx=0x7fba3c005800 comp rx=0 tx=0).stop 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 shutdown_connections 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fba30066690 0x7fba30068b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba501dc2d0 0x7fba50131650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba50138420 0x7fba501dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 --2- 172.21.15.167:0/1972981126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c004d10 0x7fba50137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 >> 172.21.15.167:0/1972981126 conn(0x7fba50069f80 msgr2=0x7fba5006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:03.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 shutdown_connections 2024-09-13T17:21:03.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.466+0000 7fba54ae5640 1 -- 172.21.15.167:0/1972981126 wait complete. 2024-09-13T17:21:03.484 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:21:03.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45d02b640 1 Processor -- start 2024-09-13T17:21:03.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45d02b640 1 -- start start 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45d02b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe4580ad5f0 0x7fe45809b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45d02b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe4580b7a50 0x7fe45809bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45d02b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4580ad9d0 con 0x7fe4580b5ea0 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45d02b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4580ae9d0 con 0x7fe4580b7a50 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45d02b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45806c9b0 con 0x7fe4580ad5f0 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe4580b7a50 0x7fe45809bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe4580b7a50 0x7fe45809bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56532/0 (socket says 172.21.15.167:56532) 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 -- 172.21.15.167:0/4215572530 learned_addr learned my addr 172.21.15.167:0/4215572530 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 -- 172.21.15.167:0/4215572530 >> v2:172.21.15.190:3300/0 conn(0x7fe4580ad5f0 msgr2=0x7fe45809b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 --2- 172.21.15.167:0/4215572530 >> v2:172.21.15.190:3300/0 conn(0x7fe4580ad5f0 0x7fe45809b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 -- 172.21.15.167:0/4215572530 >> v1:172.21.15.190:6789/0 conn(0x7fe4580b5ea0 legacy=0x7fe4580b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 -- 172.21.15.167:0/4215572530 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45806cc90 con 0x7fe4580b7a50 2024-09-13T17:21:03.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe44ffff640 1 --2- 172.21.15.167:0/4215572530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580b7a50 0x7fe45809bbf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe4580b8090 tx=0x7fe44001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f822da53934ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45659c640 1 -- 172.21.15.167:0/4215572530 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400aa660 con 0x7fe4580b7a50 2024-09-13T17:21:03.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45659c640 1 -- 172.21.15.167:0/4215572530 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4400aa7c0 con 0x7fe4580b7a50 2024-09-13T17:21:03.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.598+0000 7fe45659c640 1 -- 172.21.15.167:0/4215572530 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400aab50 con 0x7fe4580b7a50 2024-09-13T17:21:03.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- 172.21.15.167:0/4215572530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580b7a50 msgr2=0x7fe45809bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 --2- 172.21.15.167:0/4215572530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580b7a50 0x7fe45809bbf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe4580b8090 tx=0x7fe44001c4e0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- 172.21.15.167:0/4215572530 shutdown_connections 2024-09-13T17:21:03.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 --2- 172.21.15.167:0/4215572530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580b7a50 0x7fe45809bbf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 --2- 172.21.15.167:0/4215572530 >> v2:172.21.15.190:3300/0 conn(0x7fe4580ad5f0 0x7fe45809b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- 172.21.15.167:0/4215572530 >> 172.21.15.167:0/4215572530 conn(0x7fe45806b9d0 msgr2=0x7fe4580b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:03.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- 172.21.15.167:0/4215572530 shutdown_connections 2024-09-13T17:21:03.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- 172.21.15.167:0/4215572530 wait complete. 2024-09-13T17:21:03.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 Processor -- start 2024-09-13T17:21:03.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- start start 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580ad5f0 0x7fe45813f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4580b5ea0 0x7fe458099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4580b7a50 0x7fe45813d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458099220 con 0x7fe4580ad5f0 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458099500 con 0x7fe4580b7a50 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45813f200 con 0x7fe4580b5ea0 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580ad5f0 0x7fe45813f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580ad5f0 0x7fe45813f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56540/0 (socket says 172.21.15.167:56540) 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 -- 172.21.15.167:0/3602395711 learned_addr learned my addr 172.21.15.167:0/3602395711 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 -- 172.21.15.167:0/3602395711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4580b5ea0 msgr2=0x7fe458099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4580b5ea0 0x7fe458099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 -- 172.21.15.167:0/3602395711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4580b7a50 msgr2=0x7fe45813d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4580b7a50 0x7fe45813d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 -- 172.21.15.167:0/3602395711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4400094d0 con 0x7fe4580ad5f0 2024-09-13T17:21:03.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe456d9d640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580ad5f0 0x7fe45813f4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe44800b410 tx=0x7fe44800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe44f7fe640 1 -- 172.21.15.167:0/3602395711 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448011830 con 0x7fe4580ad5f0 2024-09-13T17:21:03.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe44f7fe640 1 -- 172.21.15.167:0/3602395711 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448011990 con 0x7fe4580ad5f0 2024-09-13T17:21:03.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4581df7c0 con 0x7fe4580ad5f0 2024-09-13T17:21:03.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe44f7fe640 1 -- 172.21.15.167:0/3602395711 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448011d40 con 0x7fe4580ad5f0 2024-09-13T17:21:03.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.602+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45813f9e0 con 0x7fe4580ad5f0 2024-09-13T17:21:03.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.606+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe458099000 con 0x7fe4580ad5f0 2024-09-13T17:21:03.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.606+0000 7fe44f7fe640 1 -- 172.21.15.167:0/3602395711 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe44801a400 con 0x7fe4580ad5f0 2024-09-13T17:21:03.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.606+0000 7fe44f7fe640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe438066690 0x7fe438068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.606+0000 7fe44f7fe640 1 -- 172.21.15.167:0/3602395711 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe448084500 con 0x7fe4580ad5f0 2024-09-13T17:21:03.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.606+0000 7fe44ffff640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe438066690 0x7fe438068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.606+0000 7fe44ffff640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe438066690 0x7fe438068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4400ae000 tx=0x7fe440008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.610+0000 7fe44f7fe640 1 -- 172.21.15.167:0/3602395711 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4480516c0 con 0x7fe4580ad5f0 2024-09-13T17:21:03.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.758+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe458099360 con 0x7fe4580ad5f0 2024-09-13T17:21:03.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe44f7fe640 1 -- 172.21.15.167:0/3602395711 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe458099360 con 0x7fe4580ad5f0 2024-09-13T17:21:03.763 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe438066690 msgr2=0x7fe438068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe438066690 0x7fe438068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4400ae000 tx=0x7fe440008040 comp rx=0 tx=0).stop 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580ad5f0 msgr2=0x7fe45813f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580ad5f0 0x7fe45813f4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe44800b410 tx=0x7fe44800b8d0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 shutdown_connections 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe438066690 0x7fe438068b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4580b7a50 0x7fe45813d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4580b5ea0 0x7fe458099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 --2- 172.21.15.167:0/3602395711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580ad5f0 0x7fe45813f4a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 >> 172.21.15.167:0/3602395711 conn(0x7fe45806b9d0 msgr2=0x7fe458069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 shutdown_connections 2024-09-13T17:21:03.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.762+0000 7fe45d02b640 1 -- 172.21.15.167:0/3602395711 wait complete. 2024-09-13T17:21:03.781 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:21:03.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 Processor -- start 2024-09-13T17:21:03.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 -- start start 2024-09-13T17:21:03.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c0aca80 0x7fb42c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb42c071d00 0x7fb42c0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb42c0b3620 0x7fb42c09cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c0ae000 con 0x7fb42c0b3620 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c0b2c00 con 0x7fb42c071d00 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb430ab4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c145cb0 con 0x7fb42c0aca80 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb42ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb42c0b3620 0x7fb42c09cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb42ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb42c0b3620 0x7fb42c09cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56542/0 (socket says 172.21.15.167:56542) 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.886+0000 7fb42ad9d640 1 -- 172.21.15.167:0/1655183309 learned_addr learned my addr 172.21.15.167:0/1655183309 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb42a59c640 1 --2- 172.21.15.167:0/1655183309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c0aca80 0x7fb42c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb423fff640 1 --2- 172.21.15.167:0/1655183309 >> v2:172.21.15.190:3300/0 conn(0x7fb42c071d00 0x7fb42c0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb42ad9d640 1 -- 172.21.15.167:0/1655183309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c0aca80 msgr2=0x7fb42c0ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb42ad9d640 1 --2- 172.21.15.167:0/1655183309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c0aca80 0x7fb42c0ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb42ad9d640 1 -- 172.21.15.167:0/1655183309 >> v2:172.21.15.190:3300/0 conn(0x7fb42c071d00 msgr2=0x7fb42c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb42ad9d640 1 --2- 172.21.15.167:0/1655183309 >> v2:172.21.15.190:3300/0 conn(0x7fb42c071d00 0x7fb42c0b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb42ad9d640 1 -- 172.21.15.167:0/1655183309 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c099c60 con 0x7fb42c0b3620 2024-09-13T17:21:03.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb423fff640 1 --2- 172.21.15.167:0/1655183309 >> v2:172.21.15.190:3300/0 conn(0x7fb42c071d00 0x7fb42c0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:03.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb42ad9d640 1 --2- 172.21.15.167:0/1655183309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c09cb40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb42c067a30 tx=0x7fb42401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af4916a911d3e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb429d9b640 1 -- 172.21.15.167:0/1655183309 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240a56c0 con 0x7fb42c0b3620 2024-09-13T17:21:03.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb429d9b640 1 -- 172.21.15.167:0/1655183309 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4240a5820 con 0x7fb42c0b3620 2024-09-13T17:21:03.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb429d9b640 1 -- 172.21.15.167:0/1655183309 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240a5bb0 con 0x7fb42c0b3620 2024-09-13T17:21:03.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 -- 172.21.15.167:0/1655183309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 msgr2=0x7fb42c09cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 --2- 172.21.15.167:0/1655183309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c09cb40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb42c067a30 tx=0x7fb42401c930 comp rx=0 tx=0).stop 2024-09-13T17:21:03.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 -- 172.21.15.167:0/1655183309 shutdown_connections 2024-09-13T17:21:03.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 --2- 172.21.15.167:0/1655183309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c09cb40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 --2- 172.21.15.167:0/1655183309 >> v2:172.21.15.190:3300/0 conn(0x7fb42c071d00 0x7fb42c0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 --2- 172.21.15.167:0/1655183309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c0aca80 0x7fb42c0ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 -- 172.21.15.167:0/1655183309 >> 172.21.15.167:0/1655183309 conn(0x7fb42c0b3b50 msgr2=0x7fb42c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:03.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 -- 172.21.15.167:0/1655183309 shutdown_connections 2024-09-13T17:21:03.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.890+0000 7fb430ab4640 1 -- 172.21.15.167:0/1655183309 wait complete. 2024-09-13T17:21:03.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 Processor -- start 2024-09-13T17:21:03.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 -- start start 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42c0aca80 0x7fb42c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c1df240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c06f920 0x7fb42c070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c06e460 con 0x7fb42c0b3620 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c06ea20 con 0x7fb42c0aca80 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c06fdb0 con 0x7fb42c06f920 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c1df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c1df240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56552/0 (socket says 172.21.15.167:56552) 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 -- 172.21.15.167:0/2003028911 learned_addr learned my addr 172.21.15.167:0/2003028911 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb42a59c640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42c0aca80 0x7fb42c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 -- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c06f920 msgr2=0x7fb42c070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb42ad9d640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c06f920 0x7fb42c070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c06f920 0x7fb42c070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 -- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42c0aca80 msgr2=0x7fb42c06eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42c0aca80 0x7fb42c06eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 -- 172.21.15.167:0/2003028911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424009b30 con 0x7fb42c0b3620 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb42a59c640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42c0aca80 0x7fb42c06eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb423fff640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c1df240 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c820 tx=0x7fb41400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb422ffd640 1 -- 172.21.15.167:0/2003028911 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414007a30 con 0x7fb42c0b3620 2024-09-13T17:21:03.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb422ffd640 1 -- 172.21.15.167:0/2003028911 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414007b90 con 0x7fb42c0b3620 2024-09-13T17:21:03.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c070070 con 0x7fb42c0b3620 2024-09-13T17:21:03.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb422ffd640 1 -- 172.21.15.167:0/2003028911 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41400ce10 con 0x7fb42c0b3620 2024-09-13T17:21:03.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c071010 con 0x7fb42c0b3620 2024-09-13T17:21:03.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c06ebb0 con 0x7fb42c0b3620 2024-09-13T17:21:03.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb422ffd640 1 -- 172.21.15.167:0/2003028911 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4140113f0 con 0x7fb42c0b3620 2024-09-13T17:21:03.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.894+0000 7fb422ffd640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb40c066690 0x7fb40c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:03.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.898+0000 7fb422ffd640 1 -- 172.21.15.167:0/2003028911 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb414084520 con 0x7fb42c0b3620 2024-09-13T17:21:03.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.898+0000 7fb42a59c640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb40c066690 0x7fb40c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:03.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.898+0000 7fb42a59c640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb40c066690 0x7fb40c068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0097c0 tx=0x7fb41c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:03.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:03.902+0000 7fb422ffd640 1 -- 172.21.15.167:0/2003028911 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb414051630 con 0x7fb42c0b3620 2024-09-13T17:21:04.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.046+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb42c0b30e0 con 0x7fb42c0b3620 2024-09-13T17:21:04.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.046+0000 7fb422ffd640 1 -- 172.21.15.167:0/2003028911 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb414054c50 con 0x7fb42c0b3620 2024-09-13T17:21:04.050 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2024-09-13T17:21:04.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb40c066690 msgr2=0x7fb40c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb40c066690 0x7fb40c068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0097c0 tx=0x7fb41c008040 comp rx=0 tx=0).stop 2024-09-13T17:21:04.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 msgr2=0x7fb42c1df240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c1df240 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c820 tx=0x7fb41400cce0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 shutdown_connections 2024-09-13T17:21:04.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb40c066690 0x7fb40c068b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb42c06f920 0x7fb42c070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb42c0b3620 0x7fb42c1df240 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 --2- 172.21.15.167:0/2003028911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42c0aca80 0x7fb42c06eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 >> 172.21.15.167:0/2003028911 conn(0x7fb42c0b3b50 msgr2=0x7fb42c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:04.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 shutdown_connections 2024-09-13T17:21:04.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.050+0000 7fb430ab4640 1 -- 172.21.15.167:0/2003028911 wait complete. 2024-09-13T17:21:04.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:21:04.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.186+0000 7f1c999fb640 1 Processor -- start 2024-09-13T17:21:04.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.186+0000 7f1c999fb640 1 -- start start 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c999fb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c94098a40 0x7f1c94143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c999fb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c94144490 con 0x7f1c94143fe0 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c999fb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9409d410 con 0x7f1c940b3530 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c999fb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9409b090 con 0x7f1c94098a40 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c927fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c94098a40 0x7f1c94143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c937fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1c94143fe0 0x7f1c9414dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45004/0 (socket says 172.21.15.167:45004) 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c927fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c94098a40 0x7f1c94143aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56558/0 (socket says 172.21.15.167:56558) 2024-09-13T17:21:04.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c937fe640 1 -- 172.21.15.167:0/2574226429 learned_addr learned my addr 172.21.15.167:0/2574226429 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:04.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c927fc640 1 -- 172.21.15.167:0/2574226429 >> v1:172.21.15.190:6789/0 conn(0x7f1c940b3530 legacy=0x7f1c9409cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:04.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c927fc640 1 -- 172.21.15.167:0/2574226429 >> v1:172.21.15.167:6789/0 conn(0x7f1c94143fe0 legacy=0x7f1c9414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c927fc640 1 -- 172.21.15.167:0/2574226429 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c940b3910 con 0x7f1c94098a40 2024-09-13T17:21:04.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c927fc640 1 --2- 172.21.15.167:0/2574226429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94098a40 0x7f1c94143aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c880097c0 tx=0x7f1c8801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501659801643b7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:04.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c91ffb640 1 -- 172.21.15.167:0/2574226429 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880ab660 con 0x7f1c94098a40 2024-09-13T17:21:04.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c91ffb640 1 -- 172.21.15.167:0/2574226429 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c880ab7c0 con 0x7f1c94098a40 2024-09-13T17:21:04.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.190+0000 7f1c91ffb640 1 -- 172.21.15.167:0/2574226429 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880abb50 con 0x7f1c94098a40 2024-09-13T17:21:04.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/2574226429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94098a40 msgr2=0x7f1c94143aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 --2- 172.21.15.167:0/2574226429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94098a40 0x7f1c94143aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c880097c0 tx=0x7f1c8801c460 comp rx=0 tx=0).stop 2024-09-13T17:21:04.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/2574226429 shutdown_connections 2024-09-13T17:21:04.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 --2- 172.21.15.167:0/2574226429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94098a40 0x7f1c94143aa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/2574226429 >> 172.21.15.167:0/2574226429 conn(0x7f1c940b3b50 msgr2=0x7f1c940b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:04.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/2574226429 shutdown_connections 2024-09-13T17:21:04.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/2574226429 wait complete. 2024-09-13T17:21:04.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 Processor -- start 2024-09-13T17:21:04.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- start start 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c940b3530 0x7f1c941401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c94143fe0 0x7f1c940710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c940700f0 0x7f1c9413d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9414dfd0 con 0x7f1c940700f0 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940ae0c0 con 0x7f1c940b3530 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940addc0 con 0x7f1c94143fe0 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c940700f0 0x7f1c9413d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c940700f0 0x7f1c9413d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56572/0 (socket says 172.21.15.167:56572) 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 -- 172.21.15.167:0/3766434841 learned_addr learned my addr 172.21.15.167:0/3766434841 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:04.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c927fc640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c94143fe0 0x7f1c940710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c92ffd640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c940b3530 0x7f1c941401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 -- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c94143fe0 msgr2=0x7f1c940710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c94143fe0 0x7f1c940710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 -- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c940b3530 msgr2=0x7f1c941401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c940b3530 0x7f1c941401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 -- 172.21.15.167:0/3766434841 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c88009420 con 0x7f1c940700f0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c92ffd640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c940b3530 0x7f1c941401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c937fe640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c940700f0 0x7f1c9413d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400c420 tx=0x7f1c8400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c7bfff640 1 -- 172.21.15.167:0/3766434841 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84005cf0 con 0x7f1c940700f0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c7bfff640 1 -- 172.21.15.167:0/3766434841 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84005e50 con 0x7f1c940700f0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9406e460 con 0x7f1c940700f0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c7bfff640 1 -- 172.21.15.167:0/3766434841 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840072f0 con 0x7f1c940700f0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9414e1e0 con 0x7f1c940700f0 2024-09-13T17:21:04.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.194+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94070dd0 con 0x7f1c940700f0 2024-09-13T17:21:04.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.198+0000 7f1c7bfff640 1 -- 172.21.15.167:0/3766434841 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c84007450 con 0x7f1c940700f0 2024-09-13T17:21:04.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.198+0000 7f1c7bfff640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1c800666c0 0x7f1c80068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.198+0000 7f1c7bfff640 1 -- 172.21.15.167:0/3766434841 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c84083900 con 0x7f1c940700f0 2024-09-13T17:21:04.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.198+0000 7f1c92ffd640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1c800666c0 0x7f1c80068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.198+0000 7f1c92ffd640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1c800666c0 0x7f1c80068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c007fd0 tx=0x7f1c8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:04.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.202+0000 7f1c7bfff640 1 -- 172.21.15.167:0/3766434841 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c94070dd0 con 0x7f1c940700f0 2024-09-13T17:21:04.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.346+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1c94070dd0 con 0x7f1c940700f0 2024-09-13T17:21:04.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.346+0000 7f1c7bfff640 1 -- 172.21.15.167:0/3766434841 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1c94070dd0 con 0x7f1c940700f0 2024-09-13T17:21:04.350 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:04.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1c800666c0 msgr2=0x7f1c80068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1c800666c0 0x7f1c80068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c007fd0 tx=0x7f1c8c009040 comp rx=0 tx=0).stop 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c940700f0 msgr2=0x7f1c9413d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c940700f0 0x7f1c9413d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400c420 tx=0x7f1c8400c8e0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 shutdown_connections 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1c800666c0 0x7f1c80068b80 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c007fd0 tx=0x7f1c8c009040 comp rx=0 tx=0).stop 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c940700f0 0x7f1c9413d180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c94143fe0 0x7f1c940710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 --2- 172.21.15.167:0/3766434841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c940b3530 0x7f1c941401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 >> 172.21.15.167:0/3766434841 conn(0x7f1c940b3b50 msgr2=0x7f1c941423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 shutdown_connections 2024-09-13T17:21:04.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.350+0000 7f1c999fb640 1 -- 172.21.15.167:0/3766434841 wait complete. 2024-09-13T17:21:04.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:21:04.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd851c08640 1 Processor -- start 2024-09-13T17:21:04.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd851c08640 1 -- start start 2024-09-13T17:21:04.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd851c08640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd84c06a830 0x7fd84c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd851c08640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c06a3a0 con 0x7fd84c0bada0 2024-09-13T17:21:04.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd851c08640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c145fd0 con 0x7fd84c09a650 2024-09-13T17:21:04.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd851c08640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0b6c40 con 0x7fd84c06a830 2024-09-13T17:21:04.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd84bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd84c06a830 0x7fd84c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd84b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd84c0bada0 0x7fd84c099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45014/0 (socket says 172.21.15.167:45014) 2024-09-13T17:21:04.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd84b7fe640 1 -- 172.21.15.167:0/65963345 learned_addr learned my addr 172.21.15.167:0/65963345 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:04.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd84bfff640 1 -- 172.21.15.167:0/65963345 >> v1:172.21.15.190:6789/0 conn(0x7fd84c09a650 legacy=0x7fd84c14e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd84bfff640 1 -- 172.21.15.167:0/65963345 >> v1:172.21.15.167:6789/0 conn(0x7fd84c0bada0 legacy=0x7fd84c099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd84a7fc640 1 -- 172.21.15.167:0/65963345 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689402342 0 0) 0x7fd84c06a3a0 con 0x7fd84c0bada0 2024-09-13T17:21:04.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.482+0000 7fd84bfff640 1 -- 172.21.15.167:0/65963345 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0bb180 con 0x7fd84c06a830 2024-09-13T17:21:04.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd84bfff640 1 --2- 172.21.15.167:0/65963345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c06a830 0x7fd84c145a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd844009d90 tx=0x7fd84401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfab70842256208 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:04.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd84a7fc640 1 -- 172.21.15.167:0/65963345 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440a59c0 con 0x7fd84c06a830 2024-09-13T17:21:04.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd84a7fc640 1 -- 172.21.15.167:0/65963345 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8440a5b20 con 0x7fd84c06a830 2024-09-13T17:21:04.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd84a7fc640 1 -- 172.21.15.167:0/65963345 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440ad440 con 0x7fd84c06a830 2024-09-13T17:21:04.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- 172.21.15.167:0/65963345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c06a830 msgr2=0x7fd84c145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 --2- 172.21.15.167:0/65963345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c06a830 0x7fd84c145a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd844009d90 tx=0x7fd84401c8e0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- 172.21.15.167:0/65963345 shutdown_connections 2024-09-13T17:21:04.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 --2- 172.21.15.167:0/65963345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c06a830 0x7fd84c145a90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- 172.21.15.167:0/65963345 >> 172.21.15.167:0/65963345 conn(0x7fd84c0b7e40 msgr2=0x7fd84c0b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:04.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- 172.21.15.167:0/65963345 shutdown_connections 2024-09-13T17:21:04.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- 172.21.15.167:0/65963345 wait complete. 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 Processor -- start 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- start start 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd84c06a830 0x7fd84c0a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd84c0bada0 0x7fd84c1e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c0b4f70 0x7fd84c13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0b27a0 con 0x7fd84c0b4f70 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1e2180 con 0x7fd84c0bada0 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.486+0000 7fd851c08640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0b4570 con 0x7fd84c06a830 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c0b4f70 0x7fd84c13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c0b4f70 0x7fd84c13ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56588/0 (socket says 172.21.15.167:56588) 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 -- 172.21.15.167:0/44198124 learned_addr learned my addr 172.21.15.167:0/44198124 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84affd640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd84c0bada0 0x7fd84c1e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84b7fe640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd84c06a830 0x7fd84c0a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 -- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd84c06a830 msgr2=0x7fd84c0a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd84c06a830 0x7fd84c0a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 -- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd84c0bada0 msgr2=0x7fd84c1e1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd84c0bada0 0x7fd84c1e1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 -- 172.21.15.167:0/44198124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844009a70 con 0x7fd84c0b4f70 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84b7fe640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd84c06a830 0x7fd84c0a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84bfff640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c0b4f70 0x7fd84c13ec50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8440b0040 tx=0x7fd844019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd833fff640 1 -- 172.21.15.167:0/44198124 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440add90 con 0x7fd84c0b4f70 2024-09-13T17:21:04.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd833fff640 1 -- 172.21.15.167:0/44198124 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8440b9450 con 0x7fd84c0b4f70 2024-09-13T17:21:04.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c0b29b0 con 0x7fd84c0b4f70 2024-09-13T17:21:04.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd833fff640 1 -- 172.21.15.167:0/44198124 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440b97e0 con 0x7fd84c0b4f70 2024-09-13T17:21:04.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c0b4290 con 0x7fd84c0b4f70 2024-09-13T17:21:04.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c0b2e60 con 0x7fd84c0b4f70 2024-09-13T17:21:04.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd833fff640 1 -- 172.21.15.167:0/44198124 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd8440b9940 con 0x7fd84c0b4f70 2024-09-13T17:21:04.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd833fff640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd838066690 0x7fd838068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:04.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd833fff640 1 -- 172.21.15.167:0/44198124 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd84411fb60 con 0x7fd84c0b4f70 2024-09-13T17:21:04.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84b7fe640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd838066690 0x7fd838068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:04.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.490+0000 7fd84b7fe640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd838066690 0x7fd838068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd83c000f70 tx=0x7fd83c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:04.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.494+0000 7fd833fff640 1 -- 172.21.15.167:0/44198124 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8440ecd30 con 0x7fd84c0b4f70 2024-09-13T17:21:04.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.658+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd84c145210 con 0x7fd84c0b4f70 2024-09-13T17:21:04.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.658+0000 7fd833fff640 1 -- 172.21.15.167:0/44198124 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd8440f0350 con 0x7fd84c0b4f70 2024-09-13T17:21:04.663 INFO:teuthology.orchestra.run.smithi167.stderr:listed 0 entries 2024-09-13T17:21:04.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd838066690 msgr2=0x7fd838068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd838066690 0x7fd838068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd83c000f70 tx=0x7fd83c009040 comp rx=0 tx=0).stop 2024-09-13T17:21:04.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c0b4f70 msgr2=0x7fd84c13ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:04.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c0b4f70 0x7fd84c13ec50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8440b0040 tx=0x7fd844019680 comp rx=0 tx=0).stop 2024-09-13T17:21:04.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 shutdown_connections 2024-09-13T17:21:04.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd838066690 0x7fd838068b50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84c0b4f70 0x7fd84c13ec50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd84c0bada0 0x7fd84c1e1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 --2- 172.21.15.167:0/44198124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd84c06a830 0x7fd84c0a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:04.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 >> 172.21.15.167:0/44198124 conn(0x7fd84c0b7e40 msgr2=0x7fd84c1448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:04.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 shutdown_connections 2024-09-13T17:21:04.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:04.662+0000 7fd851c08640 1 -- 172.21.15.167:0/44198124 wait complete. 2024-09-13T17:21:04.680 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2024-09-13T17:21:04.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:04.680 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:21:04.882 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:ceph-fuse[34860]: fuse finished with error 0 and tester_r 0 2024-09-13T17:21:04.884 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:21:10.985 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:21:10.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:10.986 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T17:21:11.077 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:11.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.202+0000 7ff76c61a640 1 Processor -- start 2024-09-13T17:21:11.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.202+0000 7ff76c61a640 1 -- start start 2024-09-13T17:21:11.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76c61a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff764145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76c61a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff76413f9d0 0x7ff76413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76c61a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640b00b0 con 0x7ff7640b1eb0 2024-09-13T17:21:11.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76c61a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640b2290 con 0x7ff76413f9d0 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76c61a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76406f600 con 0x7ff7640b0540 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76a3b6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff7640b1eb0 0x7ff7640b1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46900/0 (socket says 172.21.15.167:46900) 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76a3b6640 1 -- 172.21.15.167:0/434496386 learned_addr learned my addr 172.21.15.167:0/434496386 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76abb7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff76413f9d0 0x7ff76413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff769bb5640 1 --2- 172.21.15.167:0/434496386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff764145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76abb7640 1 -- 172.21.15.167:0/434496386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 msgr2=0x7ff764145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76abb7640 1 --2- 172.21.15.167:0/434496386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff764145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76abb7640 1 -- 172.21.15.167:0/434496386 >> v1:172.21.15.167:6789/0 conn(0x7ff7640b1eb0 legacy=0x7ff7640b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff7693b4640 1 -- 172.21.15.167:0/434496386 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273986739 0 0) 0x7ff7640b00b0 con 0x7ff7640b1eb0 2024-09-13T17:21:11.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76abb7640 1 -- 172.21.15.167:0/434496386 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640afa60 con 0x7ff76413f9d0 2024-09-13T17:21:11.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff76abb7640 1 --2- 172.21.15.167:0/434496386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff76413fe40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4c53b968eaec68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff7693b4640 1 -- 172.21.15.167:0/434496386 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a58b0 con 0x7ff76413f9d0 2024-09-13T17:21:11.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff7693b4640 1 -- 172.21.15.167:0/434496386 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540a5a10 con 0x7ff76413f9d0 2024-09-13T17:21:11.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.206+0000 7ff7693b4640 1 -- 172.21.15.167:0/434496386 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a5da0 con 0x7ff76413f9d0 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/434496386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 msgr2=0x7ff76413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 --2- 172.21.15.167:0/434496386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff76413fe40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75401c8e0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/434496386 shutdown_connections 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 --2- 172.21.15.167:0/434496386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff76413fe40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 --2- 172.21.15.167:0/434496386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff764145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/434496386 >> 172.21.15.167:0/434496386 conn(0x7ff7640b7250 msgr2=0x7ff7640b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/434496386 shutdown_connections 2024-09-13T17:21:11.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/434496386 wait complete. 2024-09-13T17:21:11.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 Processor -- start 2024-09-13T17:21:11.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- start start 2024-09-13T17:21:11.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff76413e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7640b1eb0 0x7ff7641486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff7641de060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764148db0 con 0x7ff76413f9d0 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764149090 con 0x7ff7640b1eb0 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76414c3c0 con 0x7ff7640b0540 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff7641de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff7641de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42120/0 (socket says 172.21.15.167:42120) 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 -- 172.21.15.167:0/2582296672 learned_addr learned my addr 172.21.15.167:0/2582296672 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff769bb5640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7640b1eb0 0x7ff7641486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76a3b6640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff76413e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 -- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 msgr2=0x7ff76413e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff76413e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 -- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7640b1eb0 msgr2=0x7ff7641486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7640b1eb0 0x7ff7641486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 -- 172.21.15.167:0/2582296672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754009a70 con 0x7ff76413f9d0 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76a3b6640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff76413e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76abb7640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff7641de060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b0040 tx=0x7ff754019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff762ffd640 1 -- 172.21.15.167:0/2582296672 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540b68b0 con 0x7ff76413f9d0 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff762ffd640 1 -- 172.21.15.167:0/2582296672 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540ba070 con 0x7ff76413f9d0 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7641457f0 con 0x7ff76413f9d0 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff762ffd640 1 -- 172.21.15.167:0/2582296672 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540b6c50 con 0x7ff76413f9d0 2024-09-13T17:21:11.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76413f1d0 con 0x7ff76413f9d0 2024-09-13T17:21:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.210+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff764145cb0 con 0x7ff76413f9d0 2024-09-13T17:21:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.214+0000 7ff762ffd640 1 -- 172.21.15.167:0/2582296672 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7540c1480 con 0x7ff76413f9d0 2024-09-13T17:21:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.214+0000 7ff762ffd640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff750066690 0x7ff750068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.214+0000 7ff762ffd640 1 -- 172.21.15.167:0/2582296672 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7540bc070 con 0x7ff76413f9d0 2024-09-13T17:21:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.214+0000 7ff76a3b6640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff750066690 0x7ff750068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.214+0000 7ff76a3b6640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff750066690 0x7ff750068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000f70 tx=0x7ff75c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.218+0000 7ff762ffd640 1 -- 172.21.15.167:0/2582296672 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff7540ee4f0 con 0x7ff76413f9d0 2024-09-13T17:21:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.378+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7640b7b50 con 0x7ff76413f9d0 2024-09-13T17:21:11.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff762ffd640 1 -- 172.21.15.167:0/2582296672 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7ff7540b6db0 con 0x7ff76413f9d0 2024-09-13T17:21:11.384 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:11.384 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff750066690 msgr2=0x7ff750068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff750066690 0x7ff750068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000f70 tx=0x7ff75c009040 comp rx=0 tx=0).stop 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 msgr2=0x7ff7641de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff7641de060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b0040 tx=0x7ff754019680 comp rx=0 tx=0).stop 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 shutdown_connections 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff750066690 0x7ff750068b50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff76413f9d0 0x7ff7641de060 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7640b1eb0 0x7ff7641486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 --2- 172.21.15.167:0/2582296672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7640b0540 0x7ff76413e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 >> 172.21.15.167:0/2582296672 conn(0x7ff7640b7250 msgr2=0x7ff7640af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 shutdown_connections 2024-09-13T17:21:11.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.382+0000 7ff76c61a640 1 -- 172.21.15.167:0/2582296672 wait complete. 2024-09-13T17:21:11.404 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:11.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a06bb9640 1 Processor -- start 2024-09-13T17:21:11.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a06bb9640 1 -- start start 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a06bb9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a000b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a06bb9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a00070ff0 0x7f9a0014e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a06bb9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a00071b10 con 0x7f9a00070bb0 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a06bb9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0006f7f0 con 0x7f9a00070ff0 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a06bb9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000b0ea0 con 0x7f9a0006f0f0 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a05156640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a00070ff0 0x7f9a0014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a05156640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a00070ff0 0x7f9a0014e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42122/0 (socket says 172.21.15.167:42122) 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.510+0000 7f9a05156640 1 -- 172.21.15.167:0/2652365429 learned_addr learned my addr 172.21.15.167:0/2652365429 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a04955640 1 --2- 172.21.15.167:0/2652365429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a000b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a05156640 1 -- 172.21.15.167:0/2652365429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 msgr2=0x7f9a000b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:11.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a05156640 1 --2- 172.21.15.167:0/2652365429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a000b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a05156640 1 -- 172.21.15.167:0/2652365429 >> v1:172.21.15.190:6789/0 conn(0x7f9a00070bb0 legacy=0x7f9a0013d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a05156640 1 -- 172.21.15.167:0/2652365429 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00071df0 con 0x7f9a00070ff0 2024-09-13T17:21:11.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a04955640 1 --2- 172.21.15.167:0/2652365429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a000b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:11.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a05156640 1 --2- 172.21.15.167:0/2652365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070ff0 0x7f9a0014e160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009e80 tx=0x7f99f801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c048ba504c6020d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f99ff7fe640 1 -- 172.21.15.167:0/2652365429 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80a57b0 con 0x7f9a00070ff0 2024-09-13T17:21:11.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f99ff7fe640 1 -- 172.21.15.167:0/2652365429 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f80a5910 con 0x7f9a00070ff0 2024-09-13T17:21:11.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f99ff7fe640 1 -- 172.21.15.167:0/2652365429 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80a5ca0 con 0x7f9a00070ff0 2024-09-13T17:21:11.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2652365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070ff0 msgr2=0x7f9a0014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2652365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070ff0 0x7f9a0014e160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009e80 tx=0x7f99f801c8f0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2652365429 shutdown_connections 2024-09-13T17:21:11.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2652365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070ff0 0x7f9a0014e160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2652365429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a000b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2652365429 >> 172.21.15.167:0/2652365429 conn(0x7f9a000b7250 msgr2=0x7f9a000b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:11.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2652365429 shutdown_connections 2024-09-13T17:21:11.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.514+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2652365429 wait complete. 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 Processor -- start 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 -- start start 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a00142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070bb0 0x7f9a00141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a00070ff0 0x7f9a001dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001439c0 con 0x7f9a00070bb0 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00142380 con 0x7f9a00070ff0 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001dc1e0 con 0x7f9a0006f0f0 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070bb0 0x7f9a00141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070bb0 0x7f9a00141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42128/0 (socket says 172.21.15.167:42128) 2024-09-13T17:21:11.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 -- 172.21.15.167:0/2725747900 learned_addr learned my addr 172.21.15.167:0/2725747900 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a04955640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a00142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a05156640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a00070ff0 0x7f9a001dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 -- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 msgr2=0x7f9a00142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a00142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 -- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a00070ff0 msgr2=0x7f9a001dbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a00070ff0 0x7f9a001dbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 -- 172.21.15.167:0/2725747900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009b30 con 0x7f9a00070bb0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fffff640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070bb0 0x7f9a00141990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c4d0 tx=0x7f99f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fd7fa640 1 -- 172.21.15.167:0/2725747900 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00052d0 con 0x7f9a00070bb0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fd7fa640 1 -- 172.21.15.167:0/2725747900 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0005430 con 0x7f9a00070bb0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a00144330 con 0x7f9a00070bb0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fd7fa640 1 -- 172.21.15.167:0/2725747900 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0012830 con 0x7f9a00070bb0 2024-09-13T17:21:11.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a001425d0 con 0x7f9a00070bb0 2024-09-13T17:21:11.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a00143c20 con 0x7f9a00070bb0 2024-09-13T17:21:11.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fd7fa640 1 -- 172.21.15.167:0/2725747900 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99f0012990 con 0x7f9a00070bb0 2024-09-13T17:21:11.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fd7fa640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f99ec066690 0x7f99ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a04955640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f99ec066690 0x7f99ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f99fd7fa640 1 -- 172.21.15.167:0/2725747900 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f99f0083eb0 con 0x7f9a00070bb0 2024-09-13T17:21:11.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.518+0000 7f9a04955640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f99ec066690 0x7f99ec068b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c900 tx=0x7f99f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.522+0000 7f99fd7fa640 1 -- 172.21.15.167:0/2725747900 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99f0050fc0 con 0x7f9a00070bb0 2024-09-13T17:21:11.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.670+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a001427c0 con 0x7f9a00070bb0 2024-09-13T17:21:11.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f99fd7fa640 1 -- 172.21.15.167:0/2725747900 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f99f00545e0 con 0x7f9a00070bb0 2024-09-13T17:21:11.676 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:11.677 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:11.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f99ec066690 msgr2=0x7f99ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f99ec066690 0x7f99ec068b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c900 tx=0x7f99f4008040 comp rx=0 tx=0).stop 2024-09-13T17:21:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070bb0 msgr2=0x7f9a00141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070bb0 0x7f9a00141990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c4d0 tx=0x7f99f000c990 comp rx=0 tx=0).stop 2024-09-13T17:21:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 shutdown_connections 2024-09-13T17:21:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f99ec066690 0x7f99ec068b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a00070ff0 0x7f9a001dbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a00070bb0 0x7f9a00141990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 --2- 172.21.15.167:0/2725747900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a0006f0f0 0x7f9a00142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 >> 172.21.15.167:0/2725747900 conn(0x7f9a000b7250 msgr2=0x7f9a0013bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 shutdown_connections 2024-09-13T17:21:11.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.674+0000 7f9a06bb9640 1 -- 172.21.15.167:0/2725747900 wait complete. 2024-09-13T17:21:11.695 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:21:11.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.802+0000 7fcbe6467640 1 Processor -- start 2024-09-13T17:21:11.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.802+0000 7fcbe6467640 1 -- start start 2024-09-13T17:21:11.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe6467640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcbe0098e10 0x7fcbe0151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe6467640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe0099370 con 0x7fcbe00b6ea0 2024-09-13T17:21:11.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe6467640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe009a7c0 con 0x7fcbe00bbff0 2024-09-13T17:21:11.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe6467640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe009a5c0 con 0x7fcbe0098e10 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcbe00b6ea0 0x7fcbe0148ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46916/0 (socket says 172.21.15.167:46916) 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdffff640 1 -- 172.21.15.167:0/3726761443 learned_addr learned my addr 172.21.15.167:0/3726761443 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192568118 0 0) 0x7fcbe0099370 con 0x7fcbe00b6ea0 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbcc003530 con 0x7fcbe00b6ea0 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 --2- 172.21.15.167:0/3726761443 >> v2:172.21.15.190:3300/0 conn(0x7fcbe0098e10 0x7fcbe0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477086064 0 0) 0x7fcbcc003530 con 0x7fcbe00b6ea0 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 >> v2:172.21.15.190:3300/0 conn(0x7fcbe0098e10 msgr2=0x7fcbe0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 --2- 172.21.15.167:0/3726761443 >> v2:172.21.15.190:3300/0 conn(0x7fcbe0098e10 0x7fcbe0151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 >> v1:172.21.15.190:6789/0 conn(0x7fcbe00bbff0 legacy=0x7fcbe0142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00b7280 con 0x7fcbe00b6ea0 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fcbd0001680 con 0x7fcbe00b6ea0 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 >> v1:172.21.15.167:6789/0 conn(0x7fcbe00b6ea0 legacy=0x7fcbe0148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbcc003980 0x7fcbcc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbcc005390 0x7fcbcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe009a5c0 con 0x7fcbcc005390 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00c220 con 0x7fcbcc0047d0 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00c3e0 con 0x7fcbcc003980 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbcc005390 0x7fcbcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdffff640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbcc003980 0x7fcbcc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbd7fff640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 -- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbcc003980 msgr2=0x7fcbcc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:11.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbcc003980 0x7fcbcc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 -- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc0047d0 msgr2=0x7fcbcc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:11.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 -- 172.21.15.167:0/3726761443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc003530 con 0x7fcbcc005390 2024-09-13T17:21:11.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbd7fff640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 -- 172.21.15.167:0/3726761443 reap_dead start 2024-09-13T17:21:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbe4a04640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbcc005390 0x7fcbcc00b990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8007360 tx=0x7fcbd801ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa7b6ea27154cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80a5d60 con 0x7fcbcc005390 2024-09-13T17:21:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80039a0 con 0x7fcbcc005390 2024-09-13T17:21:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.806+0000 7fcbdf7fe640 1 -- 172.21.15.167:0/3726761443 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8003d50 con 0x7fcbcc005390 2024-09-13T17:21:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/3726761443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbcc005390 msgr2=0x7fcbcc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbcc005390 0x7fcbcc00b990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8007360 tx=0x7fcbd801ce80 comp rx=0 tx=0).stop 2024-09-13T17:21:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/3726761443 shutdown_connections 2024-09-13T17:21:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 --2- 172.21.15.167:0/3726761443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbcc005390 0x7fcbcc00b990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/3726761443 >> 172.21.15.167:0/3726761443 conn(0x7fcbe0066440 msgr2=0x7fcbe00bb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/3726761443 shutdown_connections 2024-09-13T17:21:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/3726761443 wait complete. 2024-09-13T17:21:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 Processor -- start 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- start start 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc005390 0x7fcbe00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbe00b5300 0x7fcbe01de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe01e25a0 0x7fcbe013c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01e2110 con 0x7fcbe00b5300 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01e1ac0 con 0x7fcbcc005390 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01e1da0 con 0x7fcbe01e25a0 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbe00b5300 0x7fcbe01de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbe00b5300 0x7fcbe01de3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42150/0 (socket says 172.21.15.167:42150) 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 -- 172.21.15.167:0/1749722631 learned_addr learned my addr 172.21.15.167:0/1749722631 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:11.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbdffff640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc005390 0x7fcbe00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe4a04640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe01e25a0 0x7fcbe013c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 -- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe01e25a0 msgr2=0x7fcbe013c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe01e25a0 0x7fcbe013c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 -- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc005390 msgr2=0x7fcbe00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc005390 0x7fcbe00b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 -- 172.21.15.167:0/1749722631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00b4b90 con 0x7fcbe00b5300 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbd7fff640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbe00b5300 0x7fcbe01de3b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800d770 tx=0x7fcbc800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbdd7fa640 1 -- 172.21.15.167:0/1749722631 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8005270 con 0x7fcbe00b5300 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbdd7fa640 1 -- 172.21.15.167:0/1749722631 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc80053d0 con 0x7fcbe00b5300 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe01de8f0 con 0x7fcbe00b5300 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbdd7fa640 1 -- 172.21.15.167:0/1749722631 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800b8f0 con 0x7fcbe00b5300 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe00b2a60 con 0x7fcbe00b5300 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.810+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe01e1f60 con 0x7fcbe00b5300 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.814+0000 7fcbdd7fa640 1 -- 172.21.15.167:0/1749722631 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbc800ba50 con 0x7fcbe00b5300 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.814+0000 7fcbdd7fa640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcbc00666c0 0x7fcbc0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:11.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.814+0000 7fcbdd7fa640 1 -- 172.21.15.167:0/1749722631 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbc80843b0 con 0x7fcbe00b5300 2024-09-13T17:21:11.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.814+0000 7fcbdffff640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcbc00666c0 0x7fcbc0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:11.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.814+0000 7fcbdffff640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcbc00666c0 0x7fcbc0068b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0001ec0 tx=0x7fcbd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:11.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:11.818+0000 7fcbdd7fa640 1 -- 172.21.15.167:0/1749722631 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbc8051430 con 0x7fcbe00b5300 2024-09-13T17:21:12.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.006+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcbe01e1920 con 0x7fcbe00b5300 2024-09-13T17:21:12.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbdd7fa640 1 -- 172.21.15.167:0/1749722631 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcbe01e1920 con 0x7fcbe00b5300 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcbc00666c0 msgr2=0x7fcbc0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcbc00666c0 0x7fcbc0068b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0001ec0 tx=0x7fcbd0009040 comp rx=0 tx=0).stop 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbe00b5300 msgr2=0x7fcbe01de3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbe00b5300 0x7fcbe01de3b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800d770 tx=0x7fcbc800dc30 comp rx=0 tx=0).stop 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 shutdown_connections 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcbc00666c0 0x7fcbc0068b80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbe01e25a0 0x7fcbe013c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbe00b5300 0x7fcbe01de3b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 --2- 172.21.15.167:0/1749722631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbcc005390 0x7fcbe00b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 >> 172.21.15.167:0/1749722631 conn(0x7fcbe0066440 msgr2=0x7fcbe0140710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:12.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 shutdown_connections 2024-09-13T17:21:12.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.610+0000 7fcbe6467640 1 -- 172.21.15.167:0/1749722631 wait complete. 2024-09-13T17:21:12.634 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T17:21:12.634 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:21:12.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633b2fe640 1 Processor -- start 2024-09-13T17:21:12.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633b2fe640 1 -- start start 2024-09-13T17:21:12.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633b2fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 0x7f6334145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633b2fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f633409a650 0x7f6334150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633b2fe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633406a3a0 con 0x7f633406a830 2024-09-13T17:21:12.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633b2fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340b6c40 con 0x7f633409a650 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633b2fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6334145fd0 con 0x7f63340bada0 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f6338899640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f633406a830 0x7f6334099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46928/0 (socket says 172.21.15.167:46928) 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f6338899640 1 -- 172.21.15.167:0/2679857062 learned_addr learned my addr 172.21.15.167:0/2679857062 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633989b640 1 --2- 172.21.15.167:0/2679857062 >> v2:172.21.15.190:3300/0 conn(0x7f633409a650 0x7f6334150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f633909a640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 0x7f6334145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944902478 0 0) 0x7f633406a3a0 con 0x7f633406a830 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6320003530 con 0x7f633406a830 2024-09-13T17:21:12.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.750+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821948606 0 0) 0x7f6320003530 con 0x7f633406a830 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 msgr2=0x7f6334145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 0x7f6334145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 >> v2:172.21.15.190:3300/0 conn(0x7f633409a650 msgr2=0x7f6334150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 --2- 172.21.15.167:0/2679857062 >> v2:172.21.15.190:3300/0 conn(0x7f633409a650 0x7f6334150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340bb180 con 0x7f633406a830 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f6324001680 con 0x7f633406a830 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 >> v1:172.21.15.167:6789/0 conn(0x7f633406a830 legacy=0x7f6334099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:12.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 0x7f6320003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6320004d10 0x7f6320005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6334145fd0 con 0x7f6320003f00 2024-09-13T17:21:12.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632000b990 con 0x7f6320004d10 2024-09-13T17:21:12.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632000bb20 con 0x7f63340bada0 2024-09-13T17:21:12.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f6338899640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633909a640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 0x7f6320003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633989b640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6320004d10 0x7f6320005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f6338899640 1 -- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 msgr2=0x7f6320003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f6338899640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 0x7f6320003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f6338899640 1 -- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6320004d10 msgr2=0x7f6320005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f6338899640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6320004d10 0x7f6320005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f6338899640 1 -- 172.21.15.167:0/2679857062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320003530 con 0x7f6320003f00 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633909a640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63340bada0 0x7f6320003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:12.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633989b640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6320004d10 0x7f6320005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f6338899640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63200047d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f632400c240 tx=0x7f632401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57121704ed03965b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240a5940 con 0x7f6320003f00 2024-09-13T17:21:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63240a5aa0 con 0x7f6320003f00 2024-09-13T17:21:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f632bfff640 1 -- 172.21.15.167:0/2679857062 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240058e0 con 0x7f6320003f00 2024-09-13T17:21:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633b2fe640 1 -- 172.21.15.167:0/2679857062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 msgr2=0x7f63200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633b2fe640 1 --2- 172.21.15.167:0/2679857062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63200047d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f632400c240 tx=0x7f632401cc40 comp rx=0 tx=0).stop 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633989b640 1 -- 172.21.15.167:0/2679857062 reap_dead start 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633b2fe640 1 -- 172.21.15.167:0/2679857062 shutdown_connections 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633b2fe640 1 -- 172.21.15.167:0/2679857062 >> 172.21.15.167:0/2679857062 conn(0x7f63340b7e40 msgr2=0x7f63340b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633b2fe640 1 -- 172.21.15.167:0/2679857062 shutdown_connections 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.754+0000 7f633b2fe640 1 -- 172.21.15.167:0/2679857062 wait complete. 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 Processor -- start 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 -- start start 2024-09-13T17:21:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63341484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6334140830 0x7f633413c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6334140cb0 0x7f633413cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340a01e0 con 0x7f6320003f00 2024-09-13T17:21:12.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340a04c0 con 0x7f6334140cb0 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340b53c0 con 0x7f6334140830 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63341484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63341484d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42162/0 (socket says 172.21.15.167:42162) 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 -- 172.21.15.167:0/2605095056 learned_addr learned my addr 172.21.15.167:0/2605095056 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f6338899640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6334140830 0x7f633413c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 -- 172.21.15.167:0/2605095056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6334140830 msgr2=0x7f633413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6334140830 0x7f633413c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 -- 172.21.15.167:0/2605095056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6334140cb0 msgr2=0x7f633413cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6334140cb0 0x7f633413cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 -- 172.21.15.167:0/2605095056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633409f510 con 0x7f6320003f00 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633909a640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63341484d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63300108d0 tx=0x7f6330010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f6329ffb640 1 -- 172.21.15.167:0/2605095056 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330004220 con 0x7f6320003f00 2024-09-13T17:21:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f6329ffb640 1 -- 172.21.15.167:0/2605095056 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330004380 con 0x7f6320003f00 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63340a0db0 con 0x7f6320003f00 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f6329ffb640 1 -- 172.21.15.167:0/2605095056 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000eb20 con 0x7f6320003f00 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63341e1cf0 con 0x7f6320003f00 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6334099f40 con 0x7f6320003f00 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f6329ffb640 1 -- 172.21.15.167:0/2605095056 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f633000ec80 con 0x7f6320003f00 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.758+0000 7f6329ffb640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f63180666c0 0x7f6318068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.762+0000 7f6329ffb640 1 -- 172.21.15.167:0/2605095056 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6330084260 con 0x7f6320003f00 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.762+0000 7f6338899640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f63180666c0 0x7f6318068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:12.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.762+0000 7f6338899640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f63180666c0 0x7f6318068b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63240aa000 tx=0x7f6324001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:12.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.766+0000 7f6329ffb640 1 -- 172.21.15.167:0/2605095056 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6330051370 con 0x7f6320003f00 2024-09-13T17:21:12.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:12.942+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f63340a0320 con 0x7f6320003f00 2024-09-13T17:21:13.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.618+0000 7f6329ffb640 1 -- 172.21.15.167:0/2605095056 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f63340a0320 con 0x7f6320003f00 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f63180666c0 msgr2=0x7f6318068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f63180666c0 0x7f6318068b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63240aa000 tx=0x7f6324001a80 comp rx=0 tx=0).stop 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 msgr2=0x7f63341484d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63341484d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63300108d0 tx=0x7f6330010d90 comp rx=0 tx=0).stop 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 shutdown_connections 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f63180666c0 0x7f6318068b80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6334140cb0 0x7f633413cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6334140830 0x7f633413c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 --2- 172.21.15.167:0/2605095056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6320003f00 0x7f63341484d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 >> 172.21.15.167:0/2605095056 conn(0x7f63340b7e40 msgr2=0x7f6334065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:13.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 shutdown_connections 2024-09-13T17:21:13.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.622+0000 7f633b2fe640 1 -- 172.21.15.167:0/2605095056 wait complete. 2024-09-13T17:21:13.646 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:21:13.646 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:21:13.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.770+0000 7f7d7d24c640 1 Processor -- start 2024-09-13T17:21:13.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7d24c640 1 -- start start 2024-09-13T17:21:13.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7d24c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d78147840 0x7f7d7809a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7d24c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d78146ca0 con 0x7f7d7813cff0 2024-09-13T17:21:13.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7d24c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7813db30 con 0x7f7d780b56b0 2024-09-13T17:21:13.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7d24c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d780b5a90 con 0x7f7d78147840 2024-09-13T17:21:13.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7759e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7d7813cff0 0x7f7d7813d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46942/0 (socket says 172.21.15.167:46942) 2024-09-13T17:21:13.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7759e640 1 -- 172.21.15.167:0/254121749 learned_addr learned my addr 172.21.15.167:0/254121749 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:13.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7659c640 1 --2- 172.21.15.167:0/254121749 >> v2:172.21.15.190:3300/0 conn(0x7f7d78147840 0x7f7d7809a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758506157 0 0) 0x7f7d78146ca0 con 0x7f7d7813cff0 2024-09-13T17:21:13.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d64003530 con 0x7f7d7813cff0 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199734864 0 0) 0x7f7d64003530 con 0x7f7d7813cff0 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 >> v2:172.21.15.190:3300/0 conn(0x7f7d78147840 msgr2=0x7f7d7809a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 --2- 172.21.15.167:0/254121749 >> v2:172.21.15.190:3300/0 conn(0x7f7d78147840 0x7f7d7809a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 >> v1:172.21.15.190:6789/0 conn(0x7f7d780b56b0 legacy=0x7f7d78147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7809aac0 con 0x7f7d7813cff0 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f7d68001680 con 0x7f7d7813cff0 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 >> v1:172.21.15.167:6789/0 conn(0x7f7d7813cff0 legacy=0x7f7d7813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d64005190 0x7f7d6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780b5a90 con 0x7f7d640047d0 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6400c030 con 0x7f7d64003980 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6400c1f0 con 0x7f7d64005190 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7659c640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d76d9d640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7759e640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d64005190 0x7f7d6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7659c640 1 -- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d64005190 msgr2=0x7f7d6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7659c640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d64005190 0x7f7d6400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7659c640 1 -- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d64003980 msgr2=0x7f7d64003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7659c640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7659c640 1 -- 172.21.15.167:0/254121749 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64003530 con 0x7f7d640047d0 2024-09-13T17:21:13.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.774+0000 7f7d7759e640 1 -- 172.21.15.167:0/254121749 reap_dead start 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009fc0 tx=0x7f7d7001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f41907195de78ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700a5ba0 con 0x7f7d640047d0 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7000f040 con 0x7f7d640047d0 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d75d9b640 1 -- 172.21.15.167:0/254121749 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700ad440 con 0x7f7d640047d0 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- 172.21.15.167:0/254121749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d640047d0 msgr2=0x7f7d64004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009fc0 tx=0x7f7d7001cca0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- 172.21.15.167:0/254121749 shutdown_connections 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/254121749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- 172.21.15.167:0/254121749 >> 172.21.15.167:0/254121749 conn(0x7f7d780b8840 msgr2=0x7f7d780b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:13.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- 172.21.15.167:0/254121749 shutdown_connections 2024-09-13T17:21:13.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- 172.21.15.167:0/254121749 wait complete. 2024-09-13T17:21:13.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 Processor -- start 2024-09-13T17:21:13.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- start start 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d640047d0 0x7f7d781409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7813f780 0x7f7d781d9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d781d9650 0x7f7d781dc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781d9ad0 con 0x7f7d7813f780 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7813ff40 con 0x7f7d640047d0 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7d24c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7809da20 con 0x7f7d781d9650 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7813f780 0x7f7d781d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7813f780 0x7f7d781d9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42184/0 (socket says 172.21.15.167:42184) 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 -- 172.21.15.167:0/547832938 learned_addr learned my addr 172.21.15.167:0/547832938 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:13.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d76d9d640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d640047d0 0x7f7d781409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7759e640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d781d9650 0x7f7d781dc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 -- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d781d9650 msgr2=0x7f7d781dc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d781d9650 0x7f7d781dc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 -- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d640047d0 msgr2=0x7f7d781409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d640047d0 0x7f7d781409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d7659c640 1 -- 172.21.15.167:0/547832938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7809dd00 con 0x7f7d7813f780 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.778+0000 7f7d76d9d640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d640047d0 0x7f7d781409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d7659c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7813f780 0x7f7d781d9110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7d7001c710 tx=0x7f7d70009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d6f7fe640 1 -- 172.21.15.167:0/547832938 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70003ba0 con 0x7f7d7813f780 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d6f7fe640 1 -- 172.21.15.167:0/547832938 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70003d00 con 0x7f7d7813f780 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7809dfe0 con 0x7f7d7813f780 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d6f7fe640 1 -- 172.21.15.167:0/547832938 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700adb80 con 0x7f7d7813f780 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7813fc00 con 0x7f7d7813f780 2024-09-13T17:21:13.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7809d880 con 0x7f7d7813f780 2024-09-13T17:21:13.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d6f7fe640 1 -- 172.21.15.167:0/547832938 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d700b4040 con 0x7f7d7813f780 2024-09-13T17:21:13.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d6f7fe640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d58066690 0x7f7d58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:13.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d76d9d640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d58066690 0x7f7d58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:13.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d6f7fe640 1 -- 172.21.15.167:0/547832938 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d7011ef60 con 0x7f7d7813f780 2024-09-13T17:21:13.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.782+0000 7f7d76d9d640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d58066690 0x7f7d58068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7d60000c10 tx=0x7f7d60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:13.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.786+0000 7f7d6f7fe640 1 -- 172.21.15.167:0/547832938 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d7809d880 con 0x7f7d7813f780 2024-09-13T17:21:13.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.982+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d7809d880 con 0x7f7d7813f780 2024-09-13T17:21:13.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.982+0000 7f7d6f7fe640 1 -- 172.21.15.167:0/547832938 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3221 (secure 0 0 0) 0x7f7d700c3cb0 con 0x7f7d7813f780 2024-09-13T17:21:13.985 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:13.986 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:21:13.609389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:21:13.986 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 8 2024-09-13T17:21:13.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d58066690 msgr2=0x7f7d58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d58066690 0x7f7d58068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7d60000c10 tx=0x7f7d60009040 comp rx=0 tx=0).stop 2024-09-13T17:21:13.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7813f780 msgr2=0x7f7d781d9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:13.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7813f780 0x7f7d781d9110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7d7001c710 tx=0x7f7d70009750 comp rx=0 tx=0).stop 2024-09-13T17:21:13.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 shutdown_connections 2024-09-13T17:21:13.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d58066690 0x7f7d58068b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d781d9650 0x7f7d781dc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7813f780 0x7f7d781d9110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 --2- 172.21.15.167:0/547832938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d640047d0 0x7f7d781409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:13.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 >> 172.21.15.167:0/547832938 conn(0x7f7d780b8840 msgr2=0x7f7d780b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:13.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 shutdown_connections 2024-09-13T17:21:13.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:13.986+0000 7f7d7d24c640 1 -- 172.21.15.167:0/547832938 wait complete. 2024-09-13T17:21:14.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:14.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.110+0000 7fd16e57e640 1 Processor -- start 2024-09-13T17:21:14.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.110+0000 7fd16e57e640 1 -- start start 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd16806a2e0 0x7fd1680a0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1680a0990 0x7fd1681502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16806c1c0 con 0x7fd16806bde0 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd168146950 con 0x7fd16806a2e0 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16806b380 con 0x7fd1680a0990 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd16806a2e0 0x7fd1680a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd16806a2e0 0x7fd1680a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42196/0 (socket says 172.21.15.167:42196) 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 -- 172.21.15.167:0/3064572285 learned_addr learned my addr 172.21.15.167:0/3064572285 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16cb1b640 1 --2- 172.21.15.167:0/3064572285 >> v2:172.21.15.190:3300/0 conn(0x7fd1680a0990 0x7fd1681502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 -- 172.21.15.167:0/3064572285 >> v2:172.21.15.190:3300/0 conn(0x7fd1680a0990 msgr2=0x7fd1681502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:14.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 --2- 172.21.15.167:0/3064572285 >> v2:172.21.15.190:3300/0 conn(0x7fd1680a0990 0x7fd1681502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 -- 172.21.15.167:0/3064572285 >> v1:172.21.15.190:6789/0 conn(0x7fd16806bde0 legacy=0x7fd1680b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:14.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 -- 172.21.15.167:0/3064572285 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd168145e70 con 0x7fd16806a2e0 2024-09-13T17:21:14.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd1677fe640 1 --2- 172.21.15.167:0/3064572285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16806a2e0 0x7fd1680a0450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd1680b7e30 tx=0x7fd15001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c744f630e3ed9a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd166ffd640 1 -- 172.21.15.167:0/3064572285 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500ab620 con 0x7fd16806a2e0 2024-09-13T17:21:14.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd166ffd640 1 -- 172.21.15.167:0/3064572285 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1500ab780 con 0x7fd16806a2e0 2024-09-13T17:21:14.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd166ffd640 1 -- 172.21.15.167:0/3064572285 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500abb10 con 0x7fd16806a2e0 2024-09-13T17:21:14.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- 172.21.15.167:0/3064572285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16806a2e0 msgr2=0x7fd1680a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 --2- 172.21.15.167:0/3064572285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16806a2e0 0x7fd1680a0450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd1680b7e30 tx=0x7fd15001c420 comp rx=0 tx=0).stop 2024-09-13T17:21:14.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- 172.21.15.167:0/3064572285 shutdown_connections 2024-09-13T17:21:14.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 --2- 172.21.15.167:0/3064572285 >> v2:172.21.15.190:3300/0 conn(0x7fd1680a0990 0x7fd1681502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 --2- 172.21.15.167:0/3064572285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16806a2e0 0x7fd1680a0450 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- 172.21.15.167:0/3064572285 >> 172.21.15.167:0/3064572285 conn(0x7fd1680b7e80 msgr2=0x7fd1680b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:14.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- 172.21.15.167:0/3064572285 shutdown_connections 2024-09-13T17:21:14.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.114+0000 7fd16e57e640 1 -- 172.21.15.167:0/3064572285 wait complete. 2024-09-13T17:21:14.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 Processor -- start 2024-09-13T17:21:14.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 -- start start 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16806a2e0 0x7fd1680b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd16806bde0 0x7fd168140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1680a0990 0x7fd16813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681e1c80 con 0x7fd1680a0990 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681e1f60 con 0x7fd16806bde0 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681e2240 con 0x7fd16806a2e0 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1680a0990 0x7fd16813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1680a0990 0x7fd16813c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42202/0 (socket says 172.21.15.167:42202) 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 -- 172.21.15.167:0/2713908798 learned_addr learned my addr 172.21.15.167:0/2713908798 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd167fff640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16806a2e0 0x7fd1680b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd1677fe640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd16806bde0 0x7fd168140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 -- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16806a2e0 msgr2=0x7fd1680b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16806a2e0 0x7fd1680b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 -- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd16806bde0 msgr2=0x7fd168140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd16806bde0 0x7fd168140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 -- 172.21.15.167:0/2713908798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500094d0 con 0x7fd1680a0990 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16cb1b640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1680a0990 0x7fd16813c470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd16000cc30 tx=0x7fd16000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd164ff9640 1 -- 172.21.15.167:0/2713908798 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000ce40 con 0x7fd1680a0990 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd164ff9640 1 -- 172.21.15.167:0/2713908798 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1600039a0 con 0x7fd1680a0990 2024-09-13T17:21:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1680b1f70 con 0x7fd1680a0990 2024-09-13T17:21:14.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd164ff9640 1 -- 172.21.15.167:0/2713908798 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160003d30 con 0x7fd1680a0990 2024-09-13T17:21:14.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1681e2760 con 0x7fd1680a0990 2024-09-13T17:21:14.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1680a0450 con 0x7fd1680a0990 2024-09-13T17:21:14.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.118+0000 7fd164ff9640 1 -- 172.21.15.167:0/2713908798 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd160003e90 con 0x7fd1680a0990 2024-09-13T17:21:14.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.122+0000 7fd164ff9640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd148066690 0x7fd148068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.122+0000 7fd164ff9640 1 -- 172.21.15.167:0/2713908798 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd160084810 con 0x7fd1680a0990 2024-09-13T17:21:14.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.122+0000 7fd167fff640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd148066690 0x7fd148068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.122+0000 7fd167fff640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd148066690 0x7fd148068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd158001600 tx=0x7fd158009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.126+0000 7fd164ff9640 1 -- 172.21.15.167:0/2713908798 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd160051920 con 0x7fd1680a0990 2024-09-13T17:21:14.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.282+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1681e1dc0 con 0x7fd1680a0990 2024-09-13T17:21:14.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.282+0000 7fd164ff9640 1 -- 172.21.15.167:0/2713908798 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fd1681e1dc0 con 0x7fd1680a0990 2024-09-13T17:21:14.286 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:14.286 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:14.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd148066690 msgr2=0x7fd148068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd148066690 0x7fd148068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd158001600 tx=0x7fd158009040 comp rx=0 tx=0).stop 2024-09-13T17:21:14.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1680a0990 msgr2=0x7fd16813c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1680a0990 0x7fd16813c470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd16000cc30 tx=0x7fd16000a5c0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 shutdown_connections 2024-09-13T17:21:14.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd148066690 0x7fd148068b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1680a0990 0x7fd16813c470 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd16806bde0 0x7fd168140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 --2- 172.21.15.167:0/2713908798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16806a2e0 0x7fd1680b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 >> 172.21.15.167:0/2713908798 conn(0x7fd1680b7e80 msgr2=0x7fd168098ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:14.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 shutdown_connections 2024-09-13T17:21:14.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.286+0000 7fd16e57e640 1 -- 172.21.15.167:0/2713908798 wait complete. 2024-09-13T17:21:14.305 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:21:14.305 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:21:14.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.422+0000 7fbfcf7e6640 1 Processor -- start 2024-09-13T17:21:14.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.422+0000 7fbfcf7e6640 1 -- start start 2024-09-13T17:21:14.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.422+0000 7fbfcf7e6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 0x7fbfc80b1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.422+0000 7fbfcf7e6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc80b2a70 con 0x7fbfc80b30b0 2024-09-13T17:21:14.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.422+0000 7fbfcf7e6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc80ae290 con 0x7fbfc80b2cd0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcf7e6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80b1780 con 0x7fbfc80b0da0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcdd83640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbfc80b30b0 0x7fbfc80b2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46956/0 (socket says 172.21.15.167:46956) 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcdd83640 1 -- 172.21.15.167:0/2478151936 learned_addr learned my addr 172.21.15.167:0/2478151936 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 0x7fbfc80b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885817133 0 0) 0x7fbfc80b2a70 con 0x7fbfc80b30b0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb4003530 con 0x7fbfc80b30b0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146455391 0 0) 0x7fbfb4003530 con 0x7fbfc80b30b0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 msgr2=0x7fbfc80b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 0x7fbfc80b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 >> v1:172.21.15.190:6789/0 conn(0x7fbfc80b2cd0 legacy=0x7fbfc80b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80ae9a0 con 0x7fbfc80b30b0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fbfc0001680 con 0x7fbfc80b30b0 2024-09-13T17:21:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 >> v1:172.21.15.167:6789/0 conn(0x7fbfc80b30b0 legacy=0x7fbfc80b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb40039b0 0x7fbfb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 0x7fbfb40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb4004d10 0x7fbfb4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80b1780 con 0x7fbfb40039b0 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb400bb50 con 0x7fbfb4004d10 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb400bd10 con 0x7fbfc80b0da0 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb40039b0 0x7fbfb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfccd81640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 0x7fbfb40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcdd83640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb4004d10 0x7fbfb4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 -- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 msgr2=0x7fbfb40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc80b0da0 0x7fbfb40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 -- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb4004d10 msgr2=0x7fbfb4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb4004d10 0x7fbfb4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 -- 172.21.15.167:0/2478151936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4003530 con 0x7fbfb40039b0 2024-09-13T17:21:14.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfcd582640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb40039b0 0x7fbfb4003dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009ae0 tx=0x7fbfbc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c7747abe4353f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0a6450 con 0x7fbfb40039b0 2024-09-13T17:21:14.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc0a65b0 con 0x7fbfb40039b0 2024-09-13T17:21:14.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.426+0000 7fbfbbfff640 1 -- 172.21.15.167:0/2478151936 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0a6960 con 0x7fbfb40039b0 2024-09-13T17:21:14.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/2478151936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb40039b0 msgr2=0x7fbfb4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 --2- 172.21.15.167:0/2478151936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb40039b0 0x7fbfb4003dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009ae0 tx=0x7fbfbc01ca70 comp rx=0 tx=0).stop 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 -- 172.21.15.167:0/2478151936 reap_dead start 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/2478151936 shutdown_connections 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/2478151936 >> 172.21.15.167:0/2478151936 conn(0x7fbfc80b7250 msgr2=0x7fbfc80b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/2478151936 shutdown_connections 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/2478151936 wait complete. 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 Processor -- start 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- start start 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40039b0 0x7fbfc814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc8146600 0x7fbfc814de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfc814f5e0 0x7fbfc81442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc814cd70 con 0x7fbfc814f5e0 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8146a40 con 0x7fbfb40039b0 2024-09-13T17:21:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc814c720 con 0x7fbfc8146600 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfc814f5e0 0x7fbfc81442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfc814f5e0 0x7fbfc81442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42224/0 (socket says 172.21.15.167:42224) 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 -- 172.21.15.167:0/1584556930 learned_addr learned my addr 172.21.15.167:0/1584556930 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfccd81640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc8146600 0x7fbfc814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcd582640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40039b0 0x7fbfc814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 -- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc8146600 msgr2=0x7fbfc814de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc8146600 0x7fbfc814de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 -- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40039b0 msgr2=0x7fbfc814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40039b0 0x7fbfc814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 -- 172.21.15.167:0/1584556930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc814ca00 con 0x7fbfc814f5e0 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcd582640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40039b0 0x7fbfc814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcdd83640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfc814f5e0 0x7fbfc81442e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0000fc0 tx=0x7fbfc000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfb9ffb640 1 -- 172.21.15.167:0/1584556930 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0007440 con 0x7fbfc814f5e0 2024-09-13T17:21:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfb9ffb640 1 -- 172.21.15.167:0/1584556930 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00075a0 con 0x7fbfc814f5e0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc8147130 con 0x7fbfc814f5e0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfb9ffb640 1 -- 172.21.15.167:0/1584556930 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0004a30 con 0x7fbfc814f5e0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc814fc30 con 0x7fbfc814f5e0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.430+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc80b1c50 con 0x7fbfc814f5e0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.434+0000 7fbfb9ffb640 1 -- 172.21.15.167:0/1584556930 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbfc0004b90 con 0x7fbfc814f5e0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.434+0000 7fbfb9ffb640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbfac066690 0x7fbfac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.434+0000 7fbfcd582640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbfac066690 0x7fbfac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.434+0000 7fbfb9ffb640 1 -- 172.21.15.167:0/1584556930 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbfc0083cd0 con 0x7fbfc814f5e0 2024-09-13T17:21:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.434+0000 7fbfcd582640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbfac066690 0x7fbfac068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ad000 tx=0x7fbfbc0b2040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.438+0000 7fbfb9ffb640 1 -- 172.21.15.167:0/1584556930 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbfc0050ea0 con 0x7fbfc814f5e0 2024-09-13T17:21:14.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.594+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfc814fc30 con 0x7fbfac066690 2024-09-13T17:21:14.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.626+0000 7fbfb9ffb640 1 -- 172.21.15.167:0/1584556930 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7fbfc814fc30 con 0x7fbfac066690 2024-09-13T17:21:14.631 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:14.634 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:21:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbfac066690 msgr2=0x7fbfac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbfac066690 0x7fbfac068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ad000 tx=0x7fbfbc0b2040 comp rx=0 tx=0).stop 2024-09-13T17:21:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfc814f5e0 msgr2=0x7fbfc81442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfc814f5e0 0x7fbfc81442e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0000fc0 tx=0x7fbfc000d9d0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 shutdown_connections 2024-09-13T17:21:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbfac066690 0x7fbfac068b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfc814f5e0 0x7fbfc81442e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc8146600 0x7fbfc814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 --2- 172.21.15.167:0/1584556930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40039b0 0x7fbfc814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 >> 172.21.15.167:0/1584556930 conn(0x7fbfc80b7250 msgr2=0x7fbfc8147d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:14.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 shutdown_connections 2024-09-13T17:21:14.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.630+0000 7fbfcf7e6640 1 -- 172.21.15.167:0/1584556930 wait complete. 2024-09-13T17:21:14.648 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-13T17:21:13.499747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2070506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004290"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978674+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:20:54.978674+0000","last_peered":"2024-09-13T17:20:54.978674+0000","last_clean":"2024-09-13T17:20:54.978674+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:20:54.978674+0000","last_undegraded":"2024-09-13T17:20:54.978674+0000","last_fullsized":"2024-09-13T17:20:54.978674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964650+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:20:54.964650+0000","last_peered":"2024-09-13T17:20:54.964650+0000","last_clean":"2024-09-13T17:20:54.964650+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:20:54.964650+0000","last_undegraded":"2024-09-13T17:20:54.964650+0000","last_fullsized":"2024-09-13T17:20:54.964650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364375+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:20:56.364375+0000","last_peered":"2024-09-13T17:20:56.364375+0000","last_clean":"2024-09-13T17:20:56.364375+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:20:56.364375+0000","last_undegraded":"2024-09-13T17:20:56.364375+0000","last_fullsized":"2024-09-13T17:20:56.364375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964867+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:20:54.964867+0000","last_peered":"2024-09-13T17:20:54.964867+0000","last_clean":"2024-09-13T17:20:54.964867+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:20:54.964867+0000","last_undegraded":"2024-09-13T17:20:54.964867+0000","last_fullsized":"2024-09-13T17:20:54.964867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978333+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:20:54.978333+0000","last_peered":"2024-09-13T17:20:54.978333+0000","last_clean":"2024-09-13T17:20:54.978333+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:20:54.978333+0000","last_undegraded":"2024-09-13T17:20:54.978333+0000","last_fullsized":"2024-09-13T17:20:54.978333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319629+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:20:56.319629+0000","last_peered":"2024-09-13T17:20:56.319629+0000","last_clean":"2024-09-13T17:20:56.319629+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:20:56.319629+0000","last_undegraded":"2024-09-13T17:20:56.319629+0000","last_fullsized":"2024-09-13T17:20:56.319629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196854+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:20:55.196854+0000","last_peered":"2024-09-13T17:20:55.196854+0000","last_clean":"2024-09-13T17:20:55.196854+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:20:55.196854+0000","last_undegraded":"2024-09-13T17:20:55.196854+0000","last_fullsized":"2024-09-13T17:20:55.196854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973231+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:20:54.973231+0000","last_peered":"2024-09-13T17:20:54.973231+0000","last_clean":"2024-09-13T17:20:54.973231+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:20:54.973231+0000","last_undegraded":"2024-09-13T17:20:54.973231+0000","last_fullsized":"2024-09-13T17:20:54.973231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320003+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:20:56.320003+0000","last_peered":"2024-09-13T17:20:56.320003+0000","last_clean":"2024-09-13T17:20:56.320003+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:20:56.320003+0000","last_undegraded":"2024-09-13T17:20:56.320003+0000","last_fullsized":"2024-09-13T17:20:56.320003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195592+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:20:55.195592+0000","last_peered":"2024-09-13T17:20:55.195592+0000","last_clean":"2024-09-13T17:20:55.195592+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:20:55.195592+0000","last_undegraded":"2024-09-13T17:20:55.195592+0000","last_fullsized":"2024-09-13T17:20:55.195592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973550+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:20:54.973550+0000","last_peered":"2024-09-13T17:20:54.973550+0000","last_clean":"2024-09-13T17:20:54.973550+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:20:54.973550+0000","last_undegraded":"2024-09-13T17:20:54.973550+0000","last_fullsized":"2024-09-13T17:20:54.973550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319861+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:20:56.319861+0000","last_peered":"2024-09-13T17:20:56.319861+0000","last_clean":"2024-09-13T17:20:56.319861+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:20:56.319861+0000","last_undegraded":"2024-09-13T17:20:56.319861+0000","last_fullsized":"2024-09-13T17:20:56.319861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971678+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:20:54.971678+0000","last_peered":"2024-09-13T17:20:54.971678+0000","last_clean":"2024-09-13T17:20:54.971678+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:20:54.971678+0000","last_undegraded":"2024-09-13T17:20:54.971678+0000","last_fullsized":"2024-09-13T17:20:54.971678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195771+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:20:55.195771+0000","last_peered":"2024-09-13T17:20:55.195771+0000","last_clean":"2024-09-13T17:20:55.195771+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:20:55.195771+0000","last_undegraded":"2024-09-13T17:20:55.195771+0000","last_fullsized":"2024-09-13T17:20:55.195771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.321065+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:20:56.321065+0000","last_peered":"2024-09-13T17:20:56.321065+0000","last_clean":"2024-09-13T17:20:56.321065+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:20:56.321065+0000","last_undegraded":"2024-09-13T17:20:56.321065+0000","last_fullsized":"2024-09-13T17:20:56.321065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961879+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:20:54.961879+0000","last_peered":"2024-09-13T17:20:54.961879+0000","last_clean":"2024-09-13T17:20:54.961879+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:20:54.961879+0000","last_undegraded":"2024-09-13T17:20:54.961879+0000","last_fullsized":"2024-09-13T17:20:54.961879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979253+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:20:54.979253+0000","last_peered":"2024-09-13T17:20:54.979253+0000","last_clean":"2024-09-13T17:20:54.979253+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:20:54.979253+0000","last_undegraded":"2024-09-13T17:20:54.979253+0000","last_fullsized":"2024-09-13T17:20:54.979253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320528+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:20:56.320528+0000","last_peered":"2024-09-13T17:20:56.320528+0000","last_clean":"2024-09-13T17:20:56.320528+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:20:56.320528+0000","last_undegraded":"2024-09-13T17:20:56.320528+0000","last_fullsized":"2024-09-13T17:20:56.320528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964725+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:20:54.964725+0000","last_peered":"2024-09-13T17:20:54.964725+0000","last_clean":"2024-09-13T17:20:54.964725+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:20:54.964725+0000","last_undegraded":"2024-09-13T17:20:54.964725+0000","last_fullsized":"2024-09-13T17:20:54.964725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978739+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:20:54.978739+0000","last_peered":"2024-09-13T17:20:54.978739+0000","last_clean":"2024-09-13T17:20:54.978739+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:20:54.978739+0000","last_undegraded":"2024-09-13T17:20:54.978739+0000","last_fullsized":"2024-09-13T17:20:54.978739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357122+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:20:55.357122+0000","last_peered":"2024-09-13T17:20:55.357122+0000","last_clean":"2024-09-13T17:20:55.357122+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:20:55.357122+0000","last_undegraded":"2024-09-13T17:20:55.357122+0000","last_fullsized":"2024-09-13T17:20:55.357122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978042+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:20:54.978042+0000","last_peered":"2024-09-13T17:20:54.978042+0000","last_clean":"2024-09-13T17:20:54.978042+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:20:54.978042+0000","last_undegraded":"2024-09-13T17:20:54.978042+0000","last_fullsized":"2024-09-13T17:20:54.978042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185338+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:20:55.185338+0000","last_peered":"2024-09-13T17:20:55.185338+0000","last_clean":"2024-09-13T17:20:55.185338+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:20:55.185338+0000","last_undegraded":"2024-09-13T17:20:55.185338+0000","last_fullsized":"2024-09-13T17:20:55.185338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320965+0000","last_change":"2024-09-13T17:20:55.001193+0000","last_active":"2024-09-13T17:20:56.320965+0000","last_peered":"2024-09-13T17:20:56.320965+0000","last_clean":"2024-09-13T17:20:56.320965+0000","last_became_active":"2024-09-13T17:20:54.999414+0000","last_became_peered":"2024-09-13T17:20:54.999414+0000","last_unstale":"2024-09-13T17:20:56.320965+0000","last_undegraded":"2024-09-13T17:20:56.320965+0000","last_fullsized":"2024-09-13T17:20:56.320965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978390+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:20:54.978390+0000","last_peered":"2024-09-13T17:20:54.978390+0000","last_clean":"2024-09-13T17:20:54.978390+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:20:54.978390+0000","last_undegraded":"2024-09-13T17:20:54.978390+0000","last_fullsized":"2024-09-13T17:20:54.978390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.974170+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:20:54.974170+0000","last_peered":"2024-09-13T17:20:54.974170+0000","last_clean":"2024-09-13T17:20:54.974170+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:20:54.974170+0000","last_undegraded":"2024-09-13T17:20:54.974170+0000","last_fullsized":"2024-09-13T17:20:54.974170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319977+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:20:56.319977+0000","last_peered":"2024-09-13T17:20:56.319977+0000","last_clean":"2024-09-13T17:20:56.319977+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:20:56.319977+0000","last_undegraded":"2024-09-13T17:20:56.319977+0000","last_fullsized":"2024-09-13T17:20:56.319977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964608+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:20:54.964608+0000","last_peered":"2024-09-13T17:20:54.964608+0000","last_clean":"2024-09-13T17:20:54.964608+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:20:54.964608+0000","last_undegraded":"2024-09-13T17:20:54.964608+0000","last_fullsized":"2024-09-13T17:20:54.964608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980238+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:20:54.980238+0000","last_peered":"2024-09-13T17:20:54.980238+0000","last_clean":"2024-09-13T17:20:54.980238+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:20:54.980238+0000","last_undegraded":"2024-09-13T17:20:54.980238+0000","last_fullsized":"2024-09-13T17:20:54.980238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363397+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:20:56.363397+0000","last_peered":"2024-09-13T17:20:56.363397+0000","last_clean":"2024-09-13T17:20:56.363397+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:20:56.363397+0000","last_undegraded":"2024-09-13T17:20:56.363397+0000","last_fullsized":"2024-09-13T17:20:56.363397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980577+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:20:54.980577+0000","last_peered":"2024-09-13T17:20:54.980577+0000","last_clean":"2024-09-13T17:20:54.980577+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:20:54.980577+0000","last_undegraded":"2024-09-13T17:20:54.980577+0000","last_fullsized":"2024-09-13T17:20:54.980577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197302+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:20:55.197302+0000","last_peered":"2024-09-13T17:20:55.197302+0000","last_clean":"2024-09-13T17:20:55.197302+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:20:55.197302+0000","last_undegraded":"2024-09-13T17:20:55.197302+0000","last_fullsized":"2024-09-13T17:20:55.197302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363358+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:20:56.363358+0000","last_peered":"2024-09-13T17:20:56.363358+0000","last_clean":"2024-09-13T17:20:56.363358+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:20:56.363358+0000","last_undegraded":"2024-09-13T17:20:56.363358+0000","last_fullsized":"2024-09-13T17:20:56.363358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973762+0000","last_change":"2024-09-13T17:20:50.971732+0000","last_active":"2024-09-13T17:20:54.973762+0000","last_peered":"2024-09-13T17:20:54.973762+0000","last_clean":"2024-09-13T17:20:54.973762+0000","last_became_active":"2024-09-13T17:20:50.964584+0000","last_became_peered":"2024-09-13T17:20:50.964584+0000","last_unstale":"2024-09-13T17:20:54.973762+0000","last_undegraded":"2024-09-13T17:20:54.973762+0000","last_fullsized":"2024-09-13T17:20:54.973762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980696+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:20:54.980696+0000","last_peered":"2024-09-13T17:20:54.980696+0000","last_clean":"2024-09-13T17:20:54.980696+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:20:54.980696+0000","last_undegraded":"2024-09-13T17:20:54.980696+0000","last_fullsized":"2024-09-13T17:20:54.980696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356150+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:20:55.356150+0000","last_peered":"2024-09-13T17:20:55.356150+0000","last_clean":"2024-09-13T17:20:55.356150+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:20:55.356150+0000","last_undegraded":"2024-09-13T17:20:55.356150+0000","last_fullsized":"2024-09-13T17:20:55.356150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.988158+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:20:54.988158+0000","last_peered":"2024-09-13T17:20:54.988158+0000","last_clean":"2024-09-13T17:20:54.988158+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:20:54.988158+0000","last_undegraded":"2024-09-13T17:20:54.988158+0000","last_fullsized":"2024-09-13T17:20:54.988158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971489+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:20:54.971489+0000","last_peered":"2024-09-13T17:20:54.971489+0000","last_clean":"2024-09-13T17:20:54.971489+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:20:54.971489+0000","last_undegraded":"2024-09-13T17:20:54.971489+0000","last_fullsized":"2024-09-13T17:20:54.971489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356971+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:20:55.356971+0000","last_peered":"2024-09-13T17:20:55.356971+0000","last_clean":"2024-09-13T17:20:55.356971+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:20:55.356971+0000","last_undegraded":"2024-09-13T17:20:55.356971+0000","last_fullsized":"2024-09-13T17:20:55.356971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979502+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:20:54.979502+0000","last_peered":"2024-09-13T17:20:54.979502+0000","last_clean":"2024-09-13T17:20:54.979502+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:20:54.979502+0000","last_undegraded":"2024-09-13T17:20:54.979502+0000","last_fullsized":"2024-09-13T17:20:54.979502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958088+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:20:54.958088+0000","last_peered":"2024-09-13T17:20:54.958088+0000","last_clean":"2024-09-13T17:20:54.958088+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:20:54.958088+0000","last_undegraded":"2024-09-13T17:20:54.958088+0000","last_fullsized":"2024-09-13T17:20:54.958088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:09.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357445+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:20:55.357445+0000","last_peered":"2024-09-13T17:20:55.357445+0000","last_clean":"2024-09-13T17:20:55.357445+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:20:55.357445+0000","last_undegraded":"2024-09-13T17:20:55.357445+0000","last_fullsized":"2024-09-13T17:20:55.357445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977867+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:20:54.977867+0000","last_peered":"2024-09-13T17:20:54.977867+0000","last_clean":"2024-09-13T17:20:54.977867+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:20:54.977867+0000","last_undegraded":"2024-09-13T17:20:54.977867+0000","last_fullsized":"2024-09-13T17:20:54.977867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185295+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:20:55.185295+0000","last_peered":"2024-09-13T17:20:55.185295+0000","last_clean":"2024-09-13T17:20:55.185295+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:20:55.185295+0000","last_undegraded":"2024-09-13T17:20:55.185295+0000","last_fullsized":"2024-09-13T17:20:55.185295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363798+0000","last_change":"2024-09-13T17:20:55.185849+0000","last_active":"2024-09-13T17:20:56.363798+0000","last_peered":"2024-09-13T17:20:56.363798+0000","last_clean":"2024-09-13T17:20:56.363798+0000","last_became_active":"2024-09-13T17:20:55.185460+0000","last_became_peered":"2024-09-13T17:20:55.185460+0000","last_unstale":"2024-09-13T17:20:56.363798+0000","last_undegraded":"2024-09-13T17:20:56.363798+0000","last_fullsized":"2024-09-13T17:20:56.363798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961006+0000","last_change":"2024-09-13T17:20:50.969430+0000","last_active":"2024-09-13T17:20:54.961006+0000","last_peered":"2024-09-13T17:20:54.961006+0000","last_clean":"2024-09-13T17:20:54.961006+0000","last_became_active":"2024-09-13T17:20:50.969161+0000","last_became_peered":"2024-09-13T17:20:50.969161+0000","last_unstale":"2024-09-13T17:20:54.961006+0000","last_undegraded":"2024-09-13T17:20:54.961006+0000","last_fullsized":"2024-09-13T17:20:54.961006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.972323+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:20:54.972323+0000","last_peered":"2024-09-13T17:20:54.972323+0000","last_clean":"2024-09-13T17:20:54.972323+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:20:54.972323+0000","last_undegraded":"2024-09-13T17:20:54.972323+0000","last_fullsized":"2024-09-13T17:20:54.972323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185441+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:20:55.185441+0000","last_peered":"2024-09-13T17:20:55.185441+0000","last_clean":"2024-09-13T17:20:55.185441+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:20:55.185441+0000","last_undegraded":"2024-09-13T17:20:55.185441+0000","last_fullsized":"2024-09-13T17:20:55.185441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361982+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:20:55.361982+0000","last_peered":"2024-09-13T17:20:55.361982+0000","last_clean":"2024-09-13T17:20:55.361982+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:20:55.361982+0000","last_undegraded":"2024-09-13T17:20:55.361982+0000","last_fullsized":"2024-09-13T17:20:55.361982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196583+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:20:55.196583+0000","last_peered":"2024-09-13T17:20:55.196583+0000","last_clean":"2024-09-13T17:20:55.196583+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:20:55.196583+0000","last_undegraded":"2024-09-13T17:20:55.196583+0000","last_fullsized":"2024-09-13T17:20:55.196583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958622+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:20:54.958622+0000","last_peered":"2024-09-13T17:20:54.958622+0000","last_clean":"2024-09-13T17:20:54.958622+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:20:54.958622+0000","last_undegraded":"2024-09-13T17:20:54.958622+0000","last_fullsized":"2024-09-13T17:20:54.958622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361044+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:20:55.361044+0000","last_peered":"2024-09-13T17:20:55.361044+0000","last_clean":"2024-09-13T17:20:55.361044+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:20:55.361044+0000","last_undegraded":"2024-09-13T17:20:55.361044+0000","last_fullsized":"2024-09-13T17:20:55.361044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973440+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:20:54.973440+0000","last_peered":"2024-09-13T17:20:54.973440+0000","last_clean":"2024-09-13T17:20:54.973440+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:20:54.973440+0000","last_undegraded":"2024-09-13T17:20:54.973440+0000","last_fullsized":"2024-09-13T17:20:54.973440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980090+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:20:54.980090+0000","last_peered":"2024-09-13T17:20:54.980090+0000","last_clean":"2024-09-13T17:20:54.980090+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:20:54.980090+0000","last_undegraded":"2024-09-13T17:20:54.980090+0000","last_fullsized":"2024-09-13T17:20:54.980090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363528+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:20:56.363528+0000","last_peered":"2024-09-13T17:20:56.363528+0000","last_clean":"2024-09-13T17:20:56.363528+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:20:56.363528+0000","last_undegraded":"2024-09-13T17:20:56.363528+0000","last_fullsized":"2024-09-13T17:20:56.363528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197060+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:20:55.197060+0000","last_peered":"2024-09-13T17:20:55.197060+0000","last_clean":"2024-09-13T17:20:55.197060+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:20:55.197060+0000","last_undegraded":"2024-09-13T17:20:55.197060+0000","last_fullsized":"2024-09-13T17:20:55.197060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958535+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:20:54.958535+0000","last_peered":"2024-09-13T17:20:54.958535+0000","last_clean":"2024-09-13T17:20:54.958535+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:20:54.958535+0000","last_undegraded":"2024-09-13T17:20:54.958535+0000","last_fullsized":"2024-09-13T17:20:54.958535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:33.533450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.326297+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:20:56.326297+0000","last_peered":"2024-09-13T17:20:56.326297+0000","last_clean":"2024-09-13T17:20:56.326297+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:20:56.326297+0000","last_undegraded":"2024-09-13T17:20:56.326297+0000","last_fullsized":"2024-09-13T17:20:56.326297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196551+0000","last_change":"2024-09-13T17:20:50.999071+0000","last_active":"2024-09-13T17:20:55.196551+0000","last_peered":"2024-09-13T17:20:55.196551+0000","last_clean":"2024-09-13T17:20:55.196551+0000","last_became_active":"2024-09-13T17:20:50.998444+0000","last_became_peered":"2024-09-13T17:20:50.998444+0000","last_unstale":"2024-09-13T17:20:55.196551+0000","last_undegraded":"2024-09-13T17:20:55.196551+0000","last_fullsized":"2024-09-13T17:20:55.196551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967211+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:20:54.967211+0000","last_peered":"2024-09-13T17:20:54.967211+0000","last_clean":"2024-09-13T17:20:54.967211+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:20:54.967211+0000","last_undegraded":"2024-09-13T17:20:54.967211+0000","last_fullsized":"2024-09-13T17:20:54.967211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319624+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:20:56.319624+0000","last_peered":"2024-09-13T17:20:56.319624+0000","last_clean":"2024-09-13T17:20:56.319624+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:20:56.319624+0000","last_undegraded":"2024-09-13T17:20:56.319624+0000","last_fullsized":"2024-09-13T17:20:56.319624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187527+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:20:55.187527+0000","last_peered":"2024-09-13T17:20:55.187527+0000","last_clean":"2024-09-13T17:20:55.187527+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:20:55.187527+0000","last_undegraded":"2024-09-13T17:20:55.187527+0000","last_fullsized":"2024-09-13T17:20:55.187527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957804+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:20:54.957804+0000","last_peered":"2024-09-13T17:20:54.957804+0000","last_clean":"2024-09-13T17:20:54.957804+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:20:54.957804+0000","last_undegraded":"2024-09-13T17:20:54.957804+0000","last_fullsized":"2024-09-13T17:20:54.957804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:25.139372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363726+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:20:56.363726+0000","last_peered":"2024-09-13T17:20:56.363726+0000","last_clean":"2024-09-13T17:20:56.363726+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:20:56.363726+0000","last_undegraded":"2024-09-13T17:20:56.363726+0000","last_fullsized":"2024-09-13T17:20:56.363726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969429+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:20:54.969429+0000","last_peered":"2024-09-13T17:20:54.969429+0000","last_clean":"2024-09-13T17:20:54.969429+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:20:54.969429+0000","last_undegraded":"2024-09-13T17:20:54.969429+0000","last_fullsized":"2024-09-13T17:20:54.969429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.968862+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:20:54.968862+0000","last_peered":"2024-09-13T17:20:54.968862+0000","last_clean":"2024-09-13T17:20:54.968862+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:20:54.968862+0000","last_undegraded":"2024-09-13T17:20:54.968862+0000","last_fullsized":"2024-09-13T17:20:54.968862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364693+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:20:56.364693+0000","last_peered":"2024-09-13T17:20:56.364693+0000","last_clean":"2024-09-13T17:20:56.364693+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:20:56.364693+0000","last_undegraded":"2024-09-13T17:20:56.364693+0000","last_fullsized":"2024-09-13T17:20:56.364693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.194492+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:20:55.194492+0000","last_peered":"2024-09-13T17:20:55.194492+0000","last_clean":"2024-09-13T17:20:55.194492+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:20:55.194492+0000","last_undegraded":"2024-09-13T17:20:55.194492+0000","last_fullsized":"2024-09-13T17:20:55.194492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969703+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:20:54.969703+0000","last_peered":"2024-09-13T17:20:54.969703+0000","last_clean":"2024-09-13T17:20:54.969703+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:20:54.969703+0000","last_undegraded":"2024-09-13T17:20:54.969703+0000","last_fullsized":"2024-09-13T17:20:54.969703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364409+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:20:56.364409+0000","last_peered":"2024-09-13T17:20:56.364409+0000","last_clean":"2024-09-13T17:20:56.364409+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:20:56.364409+0000","last_undegraded":"2024-09-13T17:20:56.364409+0000","last_fullsized":"2024-09-13T17:20:56.364409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980016+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:20:54.980016+0000","last_peered":"2024-09-13T17:20:54.980016+0000","last_clean":"2024-09-13T17:20:54.980016+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:20:54.980016+0000","last_undegraded":"2024-09-13T17:20:54.980016+0000","last_fullsized":"2024-09-13T17:20:54.980016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978568+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:20:54.978568+0000","last_peered":"2024-09-13T17:20:54.978568+0000","last_clean":"2024-09-13T17:20:54.978568+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:20:54.978568+0000","last_undegraded":"2024-09-13T17:20:54.978568+0000","last_fullsized":"2024-09-13T17:20:54.978568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.327970+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:20:56.327970+0000","last_peered":"2024-09-13T17:20:56.327970+0000","last_clean":"2024-09-13T17:20:56.327970+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:20:56.327970+0000","last_undegraded":"2024-09-13T17:20:56.327970+0000","last_fullsized":"2024-09-13T17:20:56.327970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196325+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:20:55.196325+0000","last_peered":"2024-09-13T17:20:55.196325+0000","last_clean":"2024-09-13T17:20:55.196325+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:20:55.196325+0000","last_undegraded":"2024-09-13T17:20:55.196325+0000","last_fullsized":"2024-09-13T17:20:55.196325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:21:00.906533+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:21:00.906533+0000","last_peered":"2024-09-13T17:21:00.906533+0000","last_clean":"2024-09-13T17:21:00.906533+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:21:00.906533+0000","last_undegraded":"2024-09-13T17:21:00.906533+0000","last_fullsized":"2024-09-13T17:21:00.906533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356271+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:20:55.356271+0000","last_peered":"2024-09-13T17:20:55.356271+0000","last_clean":"2024-09-13T17:20:55.356271+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:20:55.356271+0000","last_undegraded":"2024-09-13T17:20:55.356271+0000","last_fullsized":"2024-09-13T17:20:55.356271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977964+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:20:54.977964+0000","last_peered":"2024-09-13T17:20:54.977964+0000","last_clean":"2024-09-13T17:20:54.977964+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:20:54.977964+0000","last_undegraded":"2024-09-13T17:20:54.977964+0000","last_fullsized":"2024-09-13T17:20:54.977964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979963+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:20:54.979963+0000","last_peered":"2024-09-13T17:20:54.979963+0000","last_clean":"2024-09-13T17:20:54.979963+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:20:54.979963+0000","last_undegraded":"2024-09-13T17:20:54.979963+0000","last_fullsized":"2024-09-13T17:20:54.979963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320279+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:20:56.320279+0000","last_peered":"2024-09-13T17:20:56.320279+0000","last_clean":"2024-09-13T17:20:56.320279+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:20:56.320279+0000","last_undegraded":"2024-09-13T17:20:56.320279+0000","last_fullsized":"2024-09-13T17:20:56.320279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978448+0000","last_change":"2024-09-13T17:20:50.950985+0000","last_active":"2024-09-13T17:20:54.978448+0000","last_peered":"2024-09-13T17:20:54.978448+0000","last_clean":"2024-09-13T17:20:54.978448+0000","last_became_active":"2024-09-13T17:20:50.950732+0000","last_became_peered":"2024-09-13T17:20:50.950732+0000","last_unstale":"2024-09-13T17:20:54.978448+0000","last_undegraded":"2024-09-13T17:20:54.978448+0000","last_fullsized":"2024-09-13T17:20:54.978448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:20.173904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975473+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:20:54.975473+0000","last_peered":"2024-09-13T17:20:54.975473+0000","last_clean":"2024-09-13T17:20:54.975473+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:20:54.975473+0000","last_undegraded":"2024-09-13T17:20:54.975473+0000","last_fullsized":"2024-09-13T17:20:54.975473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363687+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:20:56.363687+0000","last_peered":"2024-09-13T17:20:56.363687+0000","last_clean":"2024-09-13T17:20:56.363687+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:20:56.363687+0000","last_undegraded":"2024-09-13T17:20:56.363687+0000","last_fullsized":"2024-09-13T17:20:56.363687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975343+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:20:54.975343+0000","last_peered":"2024-09-13T17:20:54.975343+0000","last_clean":"2024-09-13T17:20:54.975343+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:20:54.975343+0000","last_undegraded":"2024-09-13T17:20:54.975343+0000","last_fullsized":"2024-09-13T17:20:54.975343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973950+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:20:54.973950+0000","last_peered":"2024-09-13T17:20:54.973950+0000","last_clean":"2024-09-13T17:20:54.973950+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:20:54.973950+0000","last_undegraded":"2024-09-13T17:20:54.973950+0000","last_fullsized":"2024-09-13T17:20:54.973950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364471+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:20:56.364471+0000","last_peered":"2024-09-13T17:20:56.364471+0000","last_clean":"2024-09-13T17:20:56.364471+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:20:56.364471+0000","last_undegraded":"2024-09-13T17:20:56.364471+0000","last_fullsized":"2024-09-13T17:20:56.364471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363677+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:20:56.363677+0000","last_peered":"2024-09-13T17:20:56.363677+0000","last_clean":"2024-09-13T17:20:56.363677+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:20:56.363677+0000","last_undegraded":"2024-09-13T17:20:56.363677+0000","last_fullsized":"2024-09-13T17:20:56.363677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978733+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:20:54.978733+0000","last_peered":"2024-09-13T17:20:54.978733+0000","last_clean":"2024-09-13T17:20:54.978733+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:20:54.978733+0000","last_undegraded":"2024-09-13T17:20:54.978733+0000","last_fullsized":"2024-09-13T17:20:54.978733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970268+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:20:54.970268+0000","last_peered":"2024-09-13T17:20:54.970268+0000","last_clean":"2024-09-13T17:20:54.970268+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:20:54.970268+0000","last_undegraded":"2024-09-13T17:20:54.970268+0000","last_fullsized":"2024-09-13T17:20:54.970268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.362338+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:20:55.362338+0000","last_peered":"2024-09-13T17:20:55.362338+0000","last_clean":"2024-09-13T17:20:55.362338+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:20:55.362338+0000","last_undegraded":"2024-09-13T17:20:55.362338+0000","last_fullsized":"2024-09-13T17:20:55.362338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964603+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:20:54.964603+0000","last_peered":"2024-09-13T17:20:54.964603+0000","last_clean":"2024-09-13T17:20:54.964603+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:20:54.964603+0000","last_undegraded":"2024-09-13T17:20:54.964603+0000","last_fullsized":"2024-09-13T17:20:54.964603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.965450+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:20:54.965450+0000","last_peered":"2024-09-13T17:20:54.965450+0000","last_clean":"2024-09-13T17:20:54.965450+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:20:54.965450+0000","last_undegraded":"2024-09-13T17:20:54.965450+0000","last_fullsized":"2024-09-13T17:20:54.965450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971921+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:20:54.971921+0000","last_peered":"2024-09-13T17:20:54.971921+0000","last_clean":"2024-09-13T17:20:54.971921+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:20:54.971921+0000","last_undegraded":"2024-09-13T17:20:54.971921+0000","last_fullsized":"2024-09-13T17:20:54.971921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978472+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:20:54.978472+0000","last_peered":"2024-09-13T17:20:54.978472+0000","last_clean":"2024-09-13T17:20:54.978472+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:20:54.978472+0000","last_undegraded":"2024-09-13T17:20:54.978472+0000","last_fullsized":"2024-09-13T17:20:54.978472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363860+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:20:56.363860+0000","last_peered":"2024-09-13T17:20:56.363860+0000","last_clean":"2024-09-13T17:20:56.363860+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:20:56.363860+0000","last_undegraded":"2024-09-13T17:20:56.363860+0000","last_fullsized":"2024-09-13T17:20:56.363860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:31.608726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.962109+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:20:54.962109+0000","last_peered":"2024-09-13T17:20:54.962109+0000","last_clean":"2024-09-13T17:20:54.962109+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:20:54.962109+0000","last_undegraded":"2024-09-13T17:20:54.962109+0000","last_fullsized":"2024-09-13T17:20:54.962109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967803+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:20:54.967803+0000","last_peered":"2024-09-13T17:20:54.967803+0000","last_clean":"2024-09-13T17:20:54.967803+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:20:54.967803+0000","last_undegraded":"2024-09-13T17:20:54.967803+0000","last_fullsized":"2024-09-13T17:20:54.967803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364614+0000","last_change":"2024-09-13T17:20:55.004868+0000","last_active":"2024-09-13T17:20:56.364614+0000","last_peered":"2024-09-13T17:20:56.364614+0000","last_clean":"2024-09-13T17:20:56.364614+0000","last_became_active":"2024-09-13T17:20:55.004397+0000","last_became_peered":"2024-09-13T17:20:55.004397+0000","last_unstale":"2024-09-13T17:20:56.364614+0000","last_undegraded":"2024-09-13T17:20:56.364614+0000","last_fullsized":"2024-09-13T17:20:56.364614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:51.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969083+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:20:54.969083+0000","last_peered":"2024-09-13T17:20:54.969083+0000","last_clean":"2024-09-13T17:20:54.969083+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:20:54.969083+0000","last_undegraded":"2024-09-13T17:20:54.969083+0000","last_fullsized":"2024-09-13T17:20:54.969083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957932+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:20:54.957932+0000","last_peered":"2024-09-13T17:20:54.957932+0000","last_clean":"2024-09-13T17:20:54.957932+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:20:54.957932+0000","last_undegraded":"2024-09-13T17:20:54.957932+0000","last_fullsized":"2024-09-13T17:20:54.957932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:44.697368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969569+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:20:54.969569+0000","last_peered":"2024-09-13T17:20:54.969569+0000","last_clean":"2024-09-13T17:20:54.969569+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:20:54.969569+0000","last_undegraded":"2024-09-13T17:20:54.969569+0000","last_fullsized":"2024-09-13T17:20:54.969569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978286+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:20:54.978286+0000","last_peered":"2024-09-13T17:20:54.978286+0000","last_clean":"2024-09-13T17:20:54.978286+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:20:54.978286+0000","last_undegraded":"2024-09-13T17:20:54.978286+0000","last_fullsized":"2024-09-13T17:20:54.978286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966771+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:20:54.966771+0000","last_peered":"2024-09-13T17:20:54.966771+0000","last_clean":"2024-09-13T17:20:54.966771+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:20:54.966771+0000","last_undegraded":"2024-09-13T17:20:54.966771+0000","last_fullsized":"2024-09-13T17:20:54.966771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979791+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:20:54.979791+0000","last_peered":"2024-09-13T17:20:54.979791+0000","last_clean":"2024-09-13T17:20:54.979791+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:20:54.979791+0000","last_undegraded":"2024-09-13T17:20:54.979791+0000","last_fullsized":"2024-09-13T17:20:54.979791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969316+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:20:54.969316+0000","last_peered":"2024-09-13T17:20:54.969316+0000","last_clean":"2024-09-13T17:20:54.969316+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:20:54.969316+0000","last_undegraded":"2024-09-13T17:20:54.969316+0000","last_fullsized":"2024-09-13T17:20:54.969316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964475+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:20:54.964475+0000","last_peered":"2024-09-13T17:20:54.964475+0000","last_clean":"2024-09-13T17:20:54.964475+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:20:54.964475+0000","last_undegraded":"2024-09-13T17:20:54.964475+0000","last_fullsized":"2024-09-13T17:20:54.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970101+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:20:54.970101+0000","last_peered":"2024-09-13T17:20:54.970101+0000","last_clean":"2024-09-13T17:20:54.970101+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:20:54.970101+0000","last_undegraded":"2024-09-13T17:20:54.970101+0000","last_fullsized":"2024-09-13T17:20:54.970101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.963584+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:20:54.963584+0000","last_peered":"2024-09-13T17:20:54.963584+0000","last_clean":"2024-09-13T17:20:54.963584+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:20:54.963584+0000","last_undegraded":"2024-09-13T17:20:54.963584+0000","last_fullsized":"2024-09-13T17:20:54.963584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969472+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:20:54.969472+0000","last_peered":"2024-09-13T17:20:54.969472+0000","last_clean":"2024-09-13T17:20:54.969472+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:20:54.969472+0000","last_undegraded":"2024-09-13T17:20:54.969472+0000","last_fullsized":"2024-09-13T17:20:54.969472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978177+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:20:54.978177+0000","last_peered":"2024-09-13T17:20:54.978177+0000","last_clean":"2024-09-13T17:20:54.978177+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:20:54.978177+0000","last_undegraded":"2024-09-13T17:20:54.978177+0000","last_fullsized":"2024-09-13T17:20:54.978177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966978+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:20:54.966978+0000","last_peered":"2024-09-13T17:20:54.966978+0000","last_clean":"2024-09-13T17:20:54.966978+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:20:54.966978+0000","last_undegraded":"2024-09-13T17:20:54.966978+0000","last_fullsized":"2024-09-13T17:20:54.966978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197080+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:20:55.197080+0000","last_peered":"2024-09-13T17:20:55.197080+0000","last_clean":"2024-09-13T17:20:55.197080+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:20:55.197080+0000","last_undegraded":"2024-09-13T17:20:55.197080+0000","last_fullsized":"2024-09-13T17:20:55.197080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958011+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:20:54.958011+0000","last_peered":"2024-09-13T17:20:54.958011+0000","last_clean":"2024-09-13T17:20:54.958011+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:20:54.958011+0000","last_undegraded":"2024-09-13T17:20:54.958011+0000","last_fullsized":"2024-09-13T17:20:54.958011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:03.506249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975939+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:20:54.975939+0000","last_peered":"2024-09-13T17:20:54.975939+0000","last_clean":"2024-09-13T17:20:54.975939+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:20:54.975939+0000","last_undegraded":"2024-09-13T17:20:54.975939+0000","last_fullsized":"2024-09-13T17:20:54.975939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969955+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:20:54.969955+0000","last_peered":"2024-09-13T17:20:54.969955+0000","last_clean":"2024-09-13T17:20:54.969955+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:20:54.969955+0000","last_undegraded":"2024-09-13T17:20:54.969955+0000","last_fullsized":"2024-09-13T17:20:54.969955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978607+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:20:54.978607+0000","last_peered":"2024-09-13T17:20:54.978607+0000","last_clean":"2024-09-13T17:20:54.978607+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:20:54.978607+0000","last_undegraded":"2024-09-13T17:20:54.978607+0000","last_fullsized":"2024-09-13T17:20:54.978607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979908+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:20:54.979908+0000","last_peered":"2024-09-13T17:20:54.979908+0000","last_clean":"2024-09-13T17:20:54.979908+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:20:54.979908+0000","last_undegraded":"2024-09-13T17:20:54.979908+0000","last_fullsized":"2024-09-13T17:20:54.979908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961659+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:20:54.961659+0000","last_peered":"2024-09-13T17:20:54.961659+0000","last_clean":"2024-09-13T17:20:54.961659+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:20:54.961659+0000","last_undegraded":"2024-09-13T17:20:54.961659+0000","last_fullsized":"2024-09-13T17:20:54.961659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977776+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:20:54.977776+0000","last_peered":"2024-09-13T17:20:54.977776+0000","last_clean":"2024-09-13T17:20:54.977776+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:20:54.977776+0000","last_undegraded":"2024-09-13T17:20:54.977776+0000","last_fullsized":"2024-09-13T17:20:54.977776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967718+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:20:54.967718+0000","last_peered":"2024-09-13T17:20:54.967718+0000","last_clean":"2024-09-13T17:20:54.967718+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:20:54.967718+0000","last_undegraded":"2024-09-13T17:20:54.967718+0000","last_fullsized":"2024-09-13T17:20:54.967718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969097+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:20:54.969097+0000","last_peered":"2024-09-13T17:20:54.969097+0000","last_clean":"2024-09-13T17:20:54.969097+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:20:54.969097+0000","last_undegraded":"2024-09-13T17:20:54.969097+0000","last_fullsized":"2024-09-13T17:20:54.969097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196836+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:20:55.196836+0000","last_peered":"2024-09-13T17:20:55.196836+0000","last_clean":"2024-09-13T17:20:55.196836+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:20:55.196836+0000","last_undegraded":"2024-09-13T17:20:55.196836+0000","last_fullsized":"2024-09-13T17:20:55.196836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964372+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:20:54.964372+0000","last_peered":"2024-09-13T17:20:54.964372+0000","last_clean":"2024-09-13T17:20:54.964372+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:20:54.964372+0000","last_undegraded":"2024-09-13T17:20:54.964372+0000","last_fullsized":"2024-09-13T17:20:54.964372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187418+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:20:55.187418+0000","last_peered":"2024-09-13T17:20:55.187418+0000","last_clean":"2024-09-13T17:20:55.187418+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:20:55.187418+0000","last_undegraded":"2024-09-13T17:20:55.187418+0000","last_fullsized":"2024-09-13T17:20:55.187418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969378+0000","last_change":"2024-09-13T17:20:50.961962+0000","last_active":"2024-09-13T17:20:54.969378+0000","last_peered":"2024-09-13T17:20:54.969378+0000","last_clean":"2024-09-13T17:20:54.969378+0000","last_became_active":"2024-09-13T17:20:50.959714+0000","last_became_peered":"2024-09-13T17:20:50.959714+0000","last_unstale":"2024-09-13T17:20:54.969378+0000","last_undegraded":"2024-09-13T17:20:54.969378+0000","last_fullsized":"2024-09-13T17:20:54.969378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.191758+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:20:55.191758+0000","last_peered":"2024-09-13T17:20:55.191758+0000","last_clean":"2024-09-13T17:20:55.191758+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:20:55.191758+0000","last_undegraded":"2024-09-13T17:20:55.191758+0000","last_fullsized":"2024-09-13T17:20:55.191758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973023+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:20:54.973023+0000","last_peered":"2024-09-13T17:20:54.973023+0000","last_clean":"2024-09-13T17:20:54.973023+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:20:54.973023+0000","last_undegraded":"2024-09-13T17:20:54.973023+0000","last_fullsized":"2024-09-13T17:20:54.973023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980339+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:20:54.980339+0000","last_peered":"2024-09-13T17:20:54.980339+0000","last_clean":"2024-09-13T17:20:54.980339+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:20:54.980339+0000","last_undegraded":"2024-09-13T17:20:54.980339+0000","last_fullsized":"2024-09-13T17:20:54.980339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980100+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:20:54.980100+0000","last_peered":"2024-09-13T17:20:54.980100+0000","last_clean":"2024-09-13T17:20:54.980100+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:20:54.980100+0000","last_undegraded":"2024-09-13T17:20:54.980100+0000","last_fullsized":"2024-09-13T17:20:54.980100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196594+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:20:55.196594+0000","last_peered":"2024-09-13T17:20:55.196594+0000","last_clean":"2024-09-13T17:20:55.196594+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:20:55.196594+0000","last_undegraded":"2024-09-13T17:20:55.196594+0000","last_fullsized":"2024-09-13T17:20:55.196594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":701079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:21:14.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:21:14.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.806+0000 7f488f914640 1 Processor -- start 2024-09-13T17:21:14.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.806+0000 7f488f914640 1 -- start start 2024-09-13T17:21:14.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488f914640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4888149590 0x7f48880b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488f914640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48880ba8f0 con 0x7f48880b6450 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488f914640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48880bc1a0 con 0x7f48880bbdc0 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488f914640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488813ff50 con 0x7f4888149590 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488deb1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4888149590 0x7f48880b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488ceaf640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f48880b6450 0x7f4888148e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46968/0 (socket says 172.21.15.167:46968) 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488ceaf640 1 -- 172.21.15.167:0/967234567 learned_addr learned my addr 172.21.15.167:0/967234567 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488deb1640 1 -- 172.21.15.167:0/967234567 >> v1:172.21.15.190:6789/0 conn(0x7f48880bbdc0 legacy=0x7f488813f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488deb1640 1 -- 172.21.15.167:0/967234567 >> v1:172.21.15.167:6789/0 conn(0x7f48880b6450 legacy=0x7f4888148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488deb1640 1 -- 172.21.15.167:0/967234567 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48880ba2a0 con 0x7f4888149590 2024-09-13T17:21:14.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f488deb1640 1 --2- 172.21.15.167:0/967234567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888149590 0x7f48880b9ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4880009d90 tx=0x7f488001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659989dfeff12b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f487ffff640 1 -- 172.21.15.167:0/967234567 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800a5950 con 0x7f4888149590 2024-09-13T17:21:14.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f487ffff640 1 -- 172.21.15.167:0/967234567 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800a5ab0 con 0x7f4888149590 2024-09-13T17:21:14.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.810+0000 7f487ffff640 1 -- 172.21.15.167:0/967234567 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800a5e40 con 0x7f4888149590 2024-09-13T17:21:14.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- 172.21.15.167:0/967234567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888149590 msgr2=0x7f48880b9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 --2- 172.21.15.167:0/967234567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888149590 0x7f48880b9ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4880009d90 tx=0x7f488001c870 comp rx=0 tx=0).stop 2024-09-13T17:21:14.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- 172.21.15.167:0/967234567 shutdown_connections 2024-09-13T17:21:14.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 --2- 172.21.15.167:0/967234567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888149590 0x7f48880b9ca0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- 172.21.15.167:0/967234567 >> 172.21.15.167:0/967234567 conn(0x7f488809d700 msgr2=0x7f48880bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:14.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- 172.21.15.167:0/967234567 shutdown_connections 2024-09-13T17:21:14.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- 172.21.15.167:0/967234567 wait complete. 2024-09-13T17:21:14.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 Processor -- start 2024-09-13T17:21:14.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- start start 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48880b6450 0x7f48881479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880bbdc0 0x7f488809a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4888149590 0x7f4888098c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488809f490 con 0x7f48880bbdc0 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488809ec10 con 0x7f48880b6450 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488809e400 con 0x7f4888149590 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880bbdc0 0x7f488809a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880bbdc0 0x7f488809a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42244/0 (socket says 172.21.15.167:42244) 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 -- 172.21.15.167:0/2271466351 learned_addr learned my addr 172.21.15.167:0/2271466351 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488deb1640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4888149590 0x7f4888098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 -- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4888149590 msgr2=0x7f4888098c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488d6b0640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48880b6450 0x7f48881479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4888149590 0x7f4888098c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 -- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48880b6450 msgr2=0x7f48881479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48880b6450 0x7f48881479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 -- 172.21.15.167:0/2271466351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009a70 con 0x7f48880bbdc0 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488ceaf640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880bbdc0 0x7f488809a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f487800c460 tx=0x7f487800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f487dffb640 1 -- 172.21.15.167:0/2271466351 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878005cf0 con 0x7f48880bbdc0 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f487dffb640 1 -- 172.21.15.167:0/2271466351 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878005e50 con 0x7f48880bbdc0 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48880a0160 con 0x7f48880bbdc0 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f487dffb640 1 -- 172.21.15.167:0/2271466351 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878007290 con 0x7f48880bbdc0 2024-09-13T17:21:14.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.814+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48880a03d0 con 0x7f48880bbdc0 2024-09-13T17:21:14.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.818+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48880b9ca0 con 0x7f48880bbdc0 2024-09-13T17:21:14.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.818+0000 7f487dffb640 1 -- 172.21.15.167:0/2271466351 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48780073f0 con 0x7f48880bbdc0 2024-09-13T17:21:14.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.818+0000 7f487dffb640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f486c0666c0 0x7f486c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:14.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.818+0000 7f487dffb640 1 -- 172.21.15.167:0/2271466351 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48780838f0 con 0x7f48880bbdc0 2024-09-13T17:21:14.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.818+0000 7f488d6b0640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f486c0666c0 0x7f486c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:14.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.818+0000 7f488d6b0640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f486c0666c0 0x7f486c068b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4884001600 tx=0x7f4884009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:14.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.822+0000 7f487dffb640 1 -- 172.21.15.167:0/2271466351 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4878050a00 con 0x7f48880bbdc0 2024-09-13T17:21:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.966+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4888151000 con 0x7f486c0666c0 2024-09-13T17:21:14.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.974+0000 7f487dffb640 1 -- 172.21.15.167:0/2271466351 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7f4888151000 con 0x7f486c0666c0 2024-09-13T17:21:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:14.985 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f486c0666c0 msgr2=0x7f486c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f486c0666c0 0x7f486c068b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4884001600 tx=0x7f4884009040 comp rx=0 tx=0).stop 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880bbdc0 msgr2=0x7f488809a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880bbdc0 0x7f488809a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f487800c460 tx=0x7f487800c920 comp rx=0 tx=0).stop 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 shutdown_connections 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f486c0666c0 0x7f486c068b80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4888149590 0x7f4888098c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880bbdc0 0x7f488809a430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 --2- 172.21.15.167:0/2271466351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48880b6450 0x7f48881479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:14.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 >> 172.21.15.167:0/2271466351 conn(0x7f488809d700 msgr2=0x7f48880b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:14.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 shutdown_connections 2024-09-13T17:21:14.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:14.982+0000 7f488f914640 1 -- 172.21.15.167:0/2271466351 wait complete. 2024-09-13T17:21:15.000 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-13T17:21:13.499747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2070506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004290"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978674+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:20:54.978674+0000","last_peered":"2024-09-13T17:20:54.978674+0000","last_clean":"2024-09-13T17:20:54.978674+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:20:54.978674+0000","last_undegraded":"2024-09-13T17:20:54.978674+0000","last_fullsized":"2024-09-13T17:20:54.978674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964650+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:20:54.964650+0000","last_peered":"2024-09-13T17:20:54.964650+0000","last_clean":"2024-09-13T17:20:54.964650+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:20:54.964650+0000","last_undegraded":"2024-09-13T17:20:54.964650+0000","last_fullsized":"2024-09-13T17:20:54.964650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364375+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:20:56.364375+0000","last_peered":"2024-09-13T17:20:56.364375+0000","last_clean":"2024-09-13T17:20:56.364375+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:20:56.364375+0000","last_undegraded":"2024-09-13T17:20:56.364375+0000","last_fullsized":"2024-09-13T17:20:56.364375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964867+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:20:54.964867+0000","last_peered":"2024-09-13T17:20:54.964867+0000","last_clean":"2024-09-13T17:20:54.964867+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:20:54.964867+0000","last_undegraded":"2024-09-13T17:20:54.964867+0000","last_fullsized":"2024-09-13T17:20:54.964867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978333+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:20:54.978333+0000","last_peered":"2024-09-13T17:20:54.978333+0000","last_clean":"2024-09-13T17:20:54.978333+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:20:54.978333+0000","last_undegraded":"2024-09-13T17:20:54.978333+0000","last_fullsized":"2024-09-13T17:20:54.978333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319629+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:20:56.319629+0000","last_peered":"2024-09-13T17:20:56.319629+0000","last_clean":"2024-09-13T17:20:56.319629+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:20:56.319629+0000","last_undegraded":"2024-09-13T17:20:56.319629+0000","last_fullsized":"2024-09-13T17:20:56.319629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196854+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:20:55.196854+0000","last_peered":"2024-09-13T17:20:55.196854+0000","last_clean":"2024-09-13T17:20:55.196854+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:20:55.196854+0000","last_undegraded":"2024-09-13T17:20:55.196854+0000","last_fullsized":"2024-09-13T17:20:55.196854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973231+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:20:54.973231+0000","last_peered":"2024-09-13T17:20:54.973231+0000","last_clean":"2024-09-13T17:20:54.973231+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:20:54.973231+0000","last_undegraded":"2024-09-13T17:20:54.973231+0000","last_fullsized":"2024-09-13T17:20:54.973231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320003+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:20:56.320003+0000","last_peered":"2024-09-13T17:20:56.320003+0000","last_clean":"2024-09-13T17:20:56.320003+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:20:56.320003+0000","last_undegraded":"2024-09-13T17:20:56.320003+0000","last_fullsized":"2024-09-13T17:20:56.320003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195592+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:20:55.195592+0000","last_peered":"2024-09-13T17:20:55.195592+0000","last_clean":"2024-09-13T17:20:55.195592+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:20:55.195592+0000","last_undegraded":"2024-09-13T17:20:55.195592+0000","last_fullsized":"2024-09-13T17:20:55.195592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973550+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:20:54.973550+0000","last_peered":"2024-09-13T17:20:54.973550+0000","last_clean":"2024-09-13T17:20:54.973550+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:20:54.973550+0000","last_undegraded":"2024-09-13T17:20:54.973550+0000","last_fullsized":"2024-09-13T17:20:54.973550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319861+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:20:56.319861+0000","last_peered":"2024-09-13T17:20:56.319861+0000","last_clean":"2024-09-13T17:20:56.319861+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:20:56.319861+0000","last_undegraded":"2024-09-13T17:20:56.319861+0000","last_fullsized":"2024-09-13T17:20:56.319861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971678+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:20:54.971678+0000","last_peered":"2024-09-13T17:20:54.971678+0000","last_clean":"2024-09-13T17:20:54.971678+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:20:54.971678+0000","last_undegraded":"2024-09-13T17:20:54.971678+0000","last_fullsized":"2024-09-13T17:20:54.971678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195771+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:20:55.195771+0000","last_peered":"2024-09-13T17:20:55.195771+0000","last_clean":"2024-09-13T17:20:55.195771+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:20:55.195771+0000","last_undegraded":"2024-09-13T17:20:55.195771+0000","last_fullsized":"2024-09-13T17:20:55.195771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.321065+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:20:56.321065+0000","last_peered":"2024-09-13T17:20:56.321065+0000","last_clean":"2024-09-13T17:20:56.321065+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:20:56.321065+0000","last_undegraded":"2024-09-13T17:20:56.321065+0000","last_fullsized":"2024-09-13T17:20:56.321065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961879+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:20:54.961879+0000","last_peered":"2024-09-13T17:20:54.961879+0000","last_clean":"2024-09-13T17:20:54.961879+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:20:54.961879+0000","last_undegraded":"2024-09-13T17:20:54.961879+0000","last_fullsized":"2024-09-13T17:20:54.961879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979253+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:20:54.979253+0000","last_peered":"2024-09-13T17:20:54.979253+0000","last_clean":"2024-09-13T17:20:54.979253+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:20:54.979253+0000","last_undegraded":"2024-09-13T17:20:54.979253+0000","last_fullsized":"2024-09-13T17:20:54.979253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320528+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:20:56.320528+0000","last_peered":"2024-09-13T17:20:56.320528+0000","last_clean":"2024-09-13T17:20:56.320528+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:20:56.320528+0000","last_undegraded":"2024-09-13T17:20:56.320528+0000","last_fullsized":"2024-09-13T17:20:56.320528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964725+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:20:54.964725+0000","last_peered":"2024-09-13T17:20:54.964725+0000","last_clean":"2024-09-13T17:20:54.964725+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:20:54.964725+0000","last_undegraded":"2024-09-13T17:20:54.964725+0000","last_fullsized":"2024-09-13T17:20:54.964725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978739+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:20:54.978739+0000","last_peered":"2024-09-13T17:20:54.978739+0000","last_clean":"2024-09-13T17:20:54.978739+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:20:54.978739+0000","last_undegraded":"2024-09-13T17:20:54.978739+0000","last_fullsized":"2024-09-13T17:20:54.978739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357122+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:20:55.357122+0000","last_peered":"2024-09-13T17:20:55.357122+0000","last_clean":"2024-09-13T17:20:55.357122+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:20:55.357122+0000","last_undegraded":"2024-09-13T17:20:55.357122+0000","last_fullsized":"2024-09-13T17:20:55.357122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978042+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:20:54.978042+0000","last_peered":"2024-09-13T17:20:54.978042+0000","last_clean":"2024-09-13T17:20:54.978042+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:20:54.978042+0000","last_undegraded":"2024-09-13T17:20:54.978042+0000","last_fullsized":"2024-09-13T17:20:54.978042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185338+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:20:55.185338+0000","last_peered":"2024-09-13T17:20:55.185338+0000","last_clean":"2024-09-13T17:20:55.185338+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:20:55.185338+0000","last_undegraded":"2024-09-13T17:20:55.185338+0000","last_fullsized":"2024-09-13T17:20:55.185338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320965+0000","last_change":"2024-09-13T17:20:55.001193+0000","last_active":"2024-09-13T17:20:56.320965+0000","last_peered":"2024-09-13T17:20:56.320965+0000","last_clean":"2024-09-13T17:20:56.320965+0000","last_became_active":"2024-09-13T17:20:54.999414+0000","last_became_peered":"2024-09-13T17:20:54.999414+0000","last_unstale":"2024-09-13T17:20:56.320965+0000","last_undegraded":"2024-09-13T17:20:56.320965+0000","last_fullsized":"2024-09-13T17:20:56.320965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978390+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:20:54.978390+0000","last_peered":"2024-09-13T17:20:54.978390+0000","last_clean":"2024-09-13T17:20:54.978390+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:20:54.978390+0000","last_undegraded":"2024-09-13T17:20:54.978390+0000","last_fullsized":"2024-09-13T17:20:54.978390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.974170+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:20:54.974170+0000","last_peered":"2024-09-13T17:20:54.974170+0000","last_clean":"2024-09-13T17:20:54.974170+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:20:54.974170+0000","last_undegraded":"2024-09-13T17:20:54.974170+0000","last_fullsized":"2024-09-13T17:20:54.974170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319977+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:20:56.319977+0000","last_peered":"2024-09-13T17:20:56.319977+0000","last_clean":"2024-09-13T17:20:56.319977+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:20:56.319977+0000","last_undegraded":"2024-09-13T17:20:56.319977+0000","last_fullsized":"2024-09-13T17:20:56.319977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964608+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:20:54.964608+0000","last_peered":"2024-09-13T17:20:54.964608+0000","last_clean":"2024-09-13T17:20:54.964608+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:20:54.964608+0000","last_undegraded":"2024-09-13T17:20:54.964608+0000","last_fullsized":"2024-09-13T17:20:54.964608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980238+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:20:54.980238+0000","last_peered":"2024-09-13T17:20:54.980238+0000","last_clean":"2024-09-13T17:20:54.980238+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:20:54.980238+0000","last_undegraded":"2024-09-13T17:20:54.980238+0000","last_fullsized":"2024-09-13T17:20:54.980238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363397+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:20:56.363397+0000","last_peered":"2024-09-13T17:20:56.363397+0000","last_clean":"2024-09-13T17:20:56.363397+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:20:56.363397+0000","last_undegraded":"2024-09-13T17:20:56.363397+0000","last_fullsized":"2024-09-13T17:20:56.363397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980577+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:20:54.980577+0000","last_peered":"2024-09-13T17:20:54.980577+0000","last_clean":"2024-09-13T17:20:54.980577+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:20:54.980577+0000","last_undegraded":"2024-09-13T17:20:54.980577+0000","last_fullsized":"2024-09-13T17:20:54.980577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197302+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:20:55.197302+0000","last_peered":"2024-09-13T17:20:55.197302+0000","last_clean":"2024-09-13T17:20:55.197302+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:20:55.197302+0000","last_undegraded":"2024-09-13T17:20:55.197302+0000","last_fullsized":"2024-09-13T17:20:55.197302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363358+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:20:56.363358+0000","last_peered":"2024-09-13T17:20:56.363358+0000","last_clean":"2024-09-13T17:20:56.363358+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:20:56.363358+0000","last_undegraded":"2024-09-13T17:20:56.363358+0000","last_fullsized":"2024-09-13T17:20:56.363358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973762+0000","last_change":"2024-09-13T17:20:50.971732+0000","last_active":"2024-09-13T17:20:54.973762+0000","last_peered":"2024-09-13T17:20:54.973762+0000","last_clean":"2024-09-13T17:20:54.973762+0000","last_became_active":"2024-09-13T17:20:50.964584+0000","last_became_peered":"2024-09-13T17:20:50.964584+0000","last_unstale":"2024-09-13T17:20:54.973762+0000","last_undegraded":"2024-09-13T17:20:54.973762+0000","last_fullsized":"2024-09-13T17:20:54.973762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980696+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:20:54.980696+0000","last_peered":"2024-09-13T17:20:54.980696+0000","last_clean":"2024-09-13T17:20:54.980696+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:20:54.980696+0000","last_undegraded":"2024-09-13T17:20:54.980696+0000","last_fullsized":"2024-09-13T17:20:54.980696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356150+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:20:55.356150+0000","last_peered":"2024-09-13T17:20:55.356150+0000","last_clean":"2024-09-13T17:20:55.356150+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:20:55.356150+0000","last_undegraded":"2024-09-13T17:20:55.356150+0000","last_fullsized":"2024-09-13T17:20:55.356150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.988158+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:20:54.988158+0000","last_peered":"2024-09-13T17:20:54.988158+0000","last_clean":"2024-09-13T17:20:54.988158+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:20:54.988158+0000","last_undegraded":"2024-09-13T17:20:54.988158+0000","last_fullsized":"2024-09-13T17:20:54.988158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971489+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:20:54.971489+0000","last_peered":"2024-09-13T17:20:54.971489+0000","last_clean":"2024-09-13T17:20:54.971489+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:20:54.971489+0000","last_undegraded":"2024-09-13T17:20:54.971489+0000","last_fullsized":"2024-09-13T17:20:54.971489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356971+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:20:55.356971+0000","last_peered":"2024-09-13T17:20:55.356971+0000","last_clean":"2024-09-13T17:20:55.356971+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:20:55.356971+0000","last_undegraded":"2024-09-13T17:20:55.356971+0000","last_fullsized":"2024-09-13T17:20:55.356971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979502+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:20:54.979502+0000","last_peered":"2024-09-13T17:20:54.979502+0000","last_clean":"2024-09-13T17:20:54.979502+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:20:54.979502+0000","last_undegraded":"2024-09-13T17:20:54.979502+0000","last_fullsized":"2024-09-13T17:20:54.979502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958088+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:20:54.958088+0000","last_peered":"2024-09-13T17:20:54.958088+0000","last_clean":"2024-09-13T17:20:54.958088+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:20:54.958088+0000","last_undegraded":"2024-09-13T17:20:54.958088+0000","last_fullsized":"2024-09-13T17:20:54.958088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:09.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357445+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:20:55.357445+0000","last_peered":"2024-09-13T17:20:55.357445+0000","last_clean":"2024-09-13T17:20:55.357445+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:20:55.357445+0000","last_undegraded":"2024-09-13T17:20:55.357445+0000","last_fullsized":"2024-09-13T17:20:55.357445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977867+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:20:54.977867+0000","last_peered":"2024-09-13T17:20:54.977867+0000","last_clean":"2024-09-13T17:20:54.977867+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:20:54.977867+0000","last_undegraded":"2024-09-13T17:20:54.977867+0000","last_fullsized":"2024-09-13T17:20:54.977867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185295+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:20:55.185295+0000","last_peered":"2024-09-13T17:20:55.185295+0000","last_clean":"2024-09-13T17:20:55.185295+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:20:55.185295+0000","last_undegraded":"2024-09-13T17:20:55.185295+0000","last_fullsized":"2024-09-13T17:20:55.185295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363798+0000","last_change":"2024-09-13T17:20:55.185849+0000","last_active":"2024-09-13T17:20:56.363798+0000","last_peered":"2024-09-13T17:20:56.363798+0000","last_clean":"2024-09-13T17:20:56.363798+0000","last_became_active":"2024-09-13T17:20:55.185460+0000","last_became_peered":"2024-09-13T17:20:55.185460+0000","last_unstale":"2024-09-13T17:20:56.363798+0000","last_undegraded":"2024-09-13T17:20:56.363798+0000","last_fullsized":"2024-09-13T17:20:56.363798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961006+0000","last_change":"2024-09-13T17:20:50.969430+0000","last_active":"2024-09-13T17:20:54.961006+0000","last_peered":"2024-09-13T17:20:54.961006+0000","last_clean":"2024-09-13T17:20:54.961006+0000","last_became_active":"2024-09-13T17:20:50.969161+0000","last_became_peered":"2024-09-13T17:20:50.969161+0000","last_unstale":"2024-09-13T17:20:54.961006+0000","last_undegraded":"2024-09-13T17:20:54.961006+0000","last_fullsized":"2024-09-13T17:20:54.961006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.972323+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:20:54.972323+0000","last_peered":"2024-09-13T17:20:54.972323+0000","last_clean":"2024-09-13T17:20:54.972323+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:20:54.972323+0000","last_undegraded":"2024-09-13T17:20:54.972323+0000","last_fullsized":"2024-09-13T17:20:54.972323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185441+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:20:55.185441+0000","last_peered":"2024-09-13T17:20:55.185441+0000","last_clean":"2024-09-13T17:20:55.185441+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:20:55.185441+0000","last_undegraded":"2024-09-13T17:20:55.185441+0000","last_fullsized":"2024-09-13T17:20:55.185441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361982+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:20:55.361982+0000","last_peered":"2024-09-13T17:20:55.361982+0000","last_clean":"2024-09-13T17:20:55.361982+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:20:55.361982+0000","last_undegraded":"2024-09-13T17:20:55.361982+0000","last_fullsized":"2024-09-13T17:20:55.361982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196583+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:20:55.196583+0000","last_peered":"2024-09-13T17:20:55.196583+0000","last_clean":"2024-09-13T17:20:55.196583+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:20:55.196583+0000","last_undegraded":"2024-09-13T17:20:55.196583+0000","last_fullsized":"2024-09-13T17:20:55.196583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958622+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:20:54.958622+0000","last_peered":"2024-09-13T17:20:54.958622+0000","last_clean":"2024-09-13T17:20:54.958622+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:20:54.958622+0000","last_undegraded":"2024-09-13T17:20:54.958622+0000","last_fullsized":"2024-09-13T17:20:54.958622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361044+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:20:55.361044+0000","last_peered":"2024-09-13T17:20:55.361044+0000","last_clean":"2024-09-13T17:20:55.361044+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:20:55.361044+0000","last_undegraded":"2024-09-13T17:20:55.361044+0000","last_fullsized":"2024-09-13T17:20:55.361044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973440+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:20:54.973440+0000","last_peered":"2024-09-13T17:20:54.973440+0000","last_clean":"2024-09-13T17:20:54.973440+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:20:54.973440+0000","last_undegraded":"2024-09-13T17:20:54.973440+0000","last_fullsized":"2024-09-13T17:20:54.973440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980090+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:20:54.980090+0000","last_peered":"2024-09-13T17:20:54.980090+0000","last_clean":"2024-09-13T17:20:54.980090+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:20:54.980090+0000","last_undegraded":"2024-09-13T17:20:54.980090+0000","last_fullsized":"2024-09-13T17:20:54.980090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363528+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:20:56.363528+0000","last_peered":"2024-09-13T17:20:56.363528+0000","last_clean":"2024-09-13T17:20:56.363528+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:20:56.363528+0000","last_undegraded":"2024-09-13T17:20:56.363528+0000","last_fullsized":"2024-09-13T17:20:56.363528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197060+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:20:55.197060+0000","last_peered":"2024-09-13T17:20:55.197060+0000","last_clean":"2024-09-13T17:20:55.197060+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:20:55.197060+0000","last_undegraded":"2024-09-13T17:20:55.197060+0000","last_fullsized":"2024-09-13T17:20:55.197060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958535+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:20:54.958535+0000","last_peered":"2024-09-13T17:20:54.958535+0000","last_clean":"2024-09-13T17:20:54.958535+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:20:54.958535+0000","last_undegraded":"2024-09-13T17:20:54.958535+0000","last_fullsized":"2024-09-13T17:20:54.958535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:33.533450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.326297+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:20:56.326297+0000","last_peered":"2024-09-13T17:20:56.326297+0000","last_clean":"2024-09-13T17:20:56.326297+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:20:56.326297+0000","last_undegraded":"2024-09-13T17:20:56.326297+0000","last_fullsized":"2024-09-13T17:20:56.326297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196551+0000","last_change":"2024-09-13T17:20:50.999071+0000","last_active":"2024-09-13T17:20:55.196551+0000","last_peered":"2024-09-13T17:20:55.196551+0000","last_clean":"2024-09-13T17:20:55.196551+0000","last_became_active":"2024-09-13T17:20:50.998444+0000","last_became_peered":"2024-09-13T17:20:50.998444+0000","last_unstale":"2024-09-13T17:20:55.196551+0000","last_undegraded":"2024-09-13T17:20:55.196551+0000","last_fullsized":"2024-09-13T17:20:55.196551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967211+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:20:54.967211+0000","last_peered":"2024-09-13T17:20:54.967211+0000","last_clean":"2024-09-13T17:20:54.967211+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:20:54.967211+0000","last_undegraded":"2024-09-13T17:20:54.967211+0000","last_fullsized":"2024-09-13T17:20:54.967211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319624+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:20:56.319624+0000","last_peered":"2024-09-13T17:20:56.319624+0000","last_clean":"2024-09-13T17:20:56.319624+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:20:56.319624+0000","last_undegraded":"2024-09-13T17:20:56.319624+0000","last_fullsized":"2024-09-13T17:20:56.319624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187527+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:20:55.187527+0000","last_peered":"2024-09-13T17:20:55.187527+0000","last_clean":"2024-09-13T17:20:55.187527+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:20:55.187527+0000","last_undegraded":"2024-09-13T17:20:55.187527+0000","last_fullsized":"2024-09-13T17:20:55.187527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957804+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:20:54.957804+0000","last_peered":"2024-09-13T17:20:54.957804+0000","last_clean":"2024-09-13T17:20:54.957804+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:20:54.957804+0000","last_undegraded":"2024-09-13T17:20:54.957804+0000","last_fullsized":"2024-09-13T17:20:54.957804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:25.139372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363726+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:20:56.363726+0000","last_peered":"2024-09-13T17:20:56.363726+0000","last_clean":"2024-09-13T17:20:56.363726+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:20:56.363726+0000","last_undegraded":"2024-09-13T17:20:56.363726+0000","last_fullsized":"2024-09-13T17:20:56.363726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969429+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:20:54.969429+0000","last_peered":"2024-09-13T17:20:54.969429+0000","last_clean":"2024-09-13T17:20:54.969429+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:20:54.969429+0000","last_undegraded":"2024-09-13T17:20:54.969429+0000","last_fullsized":"2024-09-13T17:20:54.969429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.968862+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:20:54.968862+0000","last_peered":"2024-09-13T17:20:54.968862+0000","last_clean":"2024-09-13T17:20:54.968862+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:20:54.968862+0000","last_undegraded":"2024-09-13T17:20:54.968862+0000","last_fullsized":"2024-09-13T17:20:54.968862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364693+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:20:56.364693+0000","last_peered":"2024-09-13T17:20:56.364693+0000","last_clean":"2024-09-13T17:20:56.364693+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:20:56.364693+0000","last_undegraded":"2024-09-13T17:20:56.364693+0000","last_fullsized":"2024-09-13T17:20:56.364693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.194492+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:20:55.194492+0000","last_peered":"2024-09-13T17:20:55.194492+0000","last_clean":"2024-09-13T17:20:55.194492+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:20:55.194492+0000","last_undegraded":"2024-09-13T17:20:55.194492+0000","last_fullsized":"2024-09-13T17:20:55.194492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969703+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:20:54.969703+0000","last_peered":"2024-09-13T17:20:54.969703+0000","last_clean":"2024-09-13T17:20:54.969703+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:20:54.969703+0000","last_undegraded":"2024-09-13T17:20:54.969703+0000","last_fullsized":"2024-09-13T17:20:54.969703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364409+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:20:56.364409+0000","last_peered":"2024-09-13T17:20:56.364409+0000","last_clean":"2024-09-13T17:20:56.364409+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:20:56.364409+0000","last_undegraded":"2024-09-13T17:20:56.364409+0000","last_fullsized":"2024-09-13T17:20:56.364409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980016+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:20:54.980016+0000","last_peered":"2024-09-13T17:20:54.980016+0000","last_clean":"2024-09-13T17:20:54.980016+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:20:54.980016+0000","last_undegraded":"2024-09-13T17:20:54.980016+0000","last_fullsized":"2024-09-13T17:20:54.980016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978568+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:20:54.978568+0000","last_peered":"2024-09-13T17:20:54.978568+0000","last_clean":"2024-09-13T17:20:54.978568+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:20:54.978568+0000","last_undegraded":"2024-09-13T17:20:54.978568+0000","last_fullsized":"2024-09-13T17:20:54.978568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.327970+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:20:56.327970+0000","last_peered":"2024-09-13T17:20:56.327970+0000","last_clean":"2024-09-13T17:20:56.327970+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:20:56.327970+0000","last_undegraded":"2024-09-13T17:20:56.327970+0000","last_fullsized":"2024-09-13T17:20:56.327970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196325+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:20:55.196325+0000","last_peered":"2024-09-13T17:20:55.196325+0000","last_clean":"2024-09-13T17:20:55.196325+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:20:55.196325+0000","last_undegraded":"2024-09-13T17:20:55.196325+0000","last_fullsized":"2024-09-13T17:20:55.196325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:21:00.906533+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:21:00.906533+0000","last_peered":"2024-09-13T17:21:00.906533+0000","last_clean":"2024-09-13T17:21:00.906533+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:21:00.906533+0000","last_undegraded":"2024-09-13T17:21:00.906533+0000","last_fullsized":"2024-09-13T17:21:00.906533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356271+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:20:55.356271+0000","last_peered":"2024-09-13T17:20:55.356271+0000","last_clean":"2024-09-13T17:20:55.356271+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:20:55.356271+0000","last_undegraded":"2024-09-13T17:20:55.356271+0000","last_fullsized":"2024-09-13T17:20:55.356271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977964+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:20:54.977964+0000","last_peered":"2024-09-13T17:20:54.977964+0000","last_clean":"2024-09-13T17:20:54.977964+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:20:54.977964+0000","last_undegraded":"2024-09-13T17:20:54.977964+0000","last_fullsized":"2024-09-13T17:20:54.977964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979963+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:20:54.979963+0000","last_peered":"2024-09-13T17:20:54.979963+0000","last_clean":"2024-09-13T17:20:54.979963+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:20:54.979963+0000","last_undegraded":"2024-09-13T17:20:54.979963+0000","last_fullsized":"2024-09-13T17:20:54.979963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320279+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:20:56.320279+0000","last_peered":"2024-09-13T17:20:56.320279+0000","last_clean":"2024-09-13T17:20:56.320279+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:20:56.320279+0000","last_undegraded":"2024-09-13T17:20:56.320279+0000","last_fullsized":"2024-09-13T17:20:56.320279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978448+0000","last_change":"2024-09-13T17:20:50.950985+0000","last_active":"2024-09-13T17:20:54.978448+0000","last_peered":"2024-09-13T17:20:54.978448+0000","last_clean":"2024-09-13T17:20:54.978448+0000","last_became_active":"2024-09-13T17:20:50.950732+0000","last_became_peered":"2024-09-13T17:20:50.950732+0000","last_unstale":"2024-09-13T17:20:54.978448+0000","last_undegraded":"2024-09-13T17:20:54.978448+0000","last_fullsized":"2024-09-13T17:20:54.978448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:20.173904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975473+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:20:54.975473+0000","last_peered":"2024-09-13T17:20:54.975473+0000","last_clean":"2024-09-13T17:20:54.975473+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:20:54.975473+0000","last_undegraded":"2024-09-13T17:20:54.975473+0000","last_fullsized":"2024-09-13T17:20:54.975473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363687+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:20:56.363687+0000","last_peered":"2024-09-13T17:20:56.363687+0000","last_clean":"2024-09-13T17:20:56.363687+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:20:56.363687+0000","last_undegraded":"2024-09-13T17:20:56.363687+0000","last_fullsized":"2024-09-13T17:20:56.363687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975343+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:20:54.975343+0000","last_peered":"2024-09-13T17:20:54.975343+0000","last_clean":"2024-09-13T17:20:54.975343+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:20:54.975343+0000","last_undegraded":"2024-09-13T17:20:54.975343+0000","last_fullsized":"2024-09-13T17:20:54.975343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973950+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:20:54.973950+0000","last_peered":"2024-09-13T17:20:54.973950+0000","last_clean":"2024-09-13T17:20:54.973950+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:20:54.973950+0000","last_undegraded":"2024-09-13T17:20:54.973950+0000","last_fullsized":"2024-09-13T17:20:54.973950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364471+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:20:56.364471+0000","last_peered":"2024-09-13T17:20:56.364471+0000","last_clean":"2024-09-13T17:20:56.364471+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:20:56.364471+0000","last_undegraded":"2024-09-13T17:20:56.364471+0000","last_fullsized":"2024-09-13T17:20:56.364471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363677+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:20:56.363677+0000","last_peered":"2024-09-13T17:20:56.363677+0000","last_clean":"2024-09-13T17:20:56.363677+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:20:56.363677+0000","last_undegraded":"2024-09-13T17:20:56.363677+0000","last_fullsized":"2024-09-13T17:20:56.363677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978733+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:20:54.978733+0000","last_peered":"2024-09-13T17:20:54.978733+0000","last_clean":"2024-09-13T17:20:54.978733+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:20:54.978733+0000","last_undegraded":"2024-09-13T17:20:54.978733+0000","last_fullsized":"2024-09-13T17:20:54.978733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970268+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:20:54.970268+0000","last_peered":"2024-09-13T17:20:54.970268+0000","last_clean":"2024-09-13T17:20:54.970268+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:20:54.970268+0000","last_undegraded":"2024-09-13T17:20:54.970268+0000","last_fullsized":"2024-09-13T17:20:54.970268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.362338+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:20:55.362338+0000","last_peered":"2024-09-13T17:20:55.362338+0000","last_clean":"2024-09-13T17:20:55.362338+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:20:55.362338+0000","last_undegraded":"2024-09-13T17:20:55.362338+0000","last_fullsized":"2024-09-13T17:20:55.362338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964603+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:20:54.964603+0000","last_peered":"2024-09-13T17:20:54.964603+0000","last_clean":"2024-09-13T17:20:54.964603+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:20:54.964603+0000","last_undegraded":"2024-09-13T17:20:54.964603+0000","last_fullsized":"2024-09-13T17:20:54.964603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.965450+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:20:54.965450+0000","last_peered":"2024-09-13T17:20:54.965450+0000","last_clean":"2024-09-13T17:20:54.965450+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:20:54.965450+0000","last_undegraded":"2024-09-13T17:20:54.965450+0000","last_fullsized":"2024-09-13T17:20:54.965450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971921+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:20:54.971921+0000","last_peered":"2024-09-13T17:20:54.971921+0000","last_clean":"2024-09-13T17:20:54.971921+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:20:54.971921+0000","last_undegraded":"2024-09-13T17:20:54.971921+0000","last_fullsized":"2024-09-13T17:20:54.971921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978472+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:20:54.978472+0000","last_peered":"2024-09-13T17:20:54.978472+0000","last_clean":"2024-09-13T17:20:54.978472+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:20:54.978472+0000","last_undegraded":"2024-09-13T17:20:54.978472+0000","last_fullsized":"2024-09-13T17:20:54.978472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363860+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:20:56.363860+0000","last_peered":"2024-09-13T17:20:56.363860+0000","last_clean":"2024-09-13T17:20:56.363860+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:20:56.363860+0000","last_undegraded":"2024-09-13T17:20:56.363860+0000","last_fullsized":"2024-09-13T17:20:56.363860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:31.608726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.962109+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:20:54.962109+0000","last_peered":"2024-09-13T17:20:54.962109+0000","last_clean":"2024-09-13T17:20:54.962109+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:20:54.962109+0000","last_undegraded":"2024-09-13T17:20:54.962109+0000","last_fullsized":"2024-09-13T17:20:54.962109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967803+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:20:54.967803+0000","last_peered":"2024-09-13T17:20:54.967803+0000","last_clean":"2024-09-13T17:20:54.967803+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:20:54.967803+0000","last_undegraded":"2024-09-13T17:20:54.967803+0000","last_fullsized":"2024-09-13T17:20:54.967803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364614+0000","last_change":"2024-09-13T17:20:55.004868+0000","last_active":"2024-09-13T17:20:56.364614+0000","last_peered":"2024-09-13T17:20:56.364614+0000","last_clean":"2024-09-13T17:20:56.364614+0000","last_became_active":"2024-09-13T17:20:55.004397+0000","last_became_peered":"2024-09-13T17:20:55.004397+0000","last_unstale":"2024-09-13T17:20:56.364614+0000","last_undegraded":"2024-09-13T17:20:56.364614+0000","last_fullsized":"2024-09-13T17:20:56.364614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:51.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969083+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:20:54.969083+0000","last_peered":"2024-09-13T17:20:54.969083+0000","last_clean":"2024-09-13T17:20:54.969083+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:20:54.969083+0000","last_undegraded":"2024-09-13T17:20:54.969083+0000","last_fullsized":"2024-09-13T17:20:54.969083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957932+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:20:54.957932+0000","last_peered":"2024-09-13T17:20:54.957932+0000","last_clean":"2024-09-13T17:20:54.957932+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:20:54.957932+0000","last_undegraded":"2024-09-13T17:20:54.957932+0000","last_fullsized":"2024-09-13T17:20:54.957932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:44.697368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969569+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:20:54.969569+0000","last_peered":"2024-09-13T17:20:54.969569+0000","last_clean":"2024-09-13T17:20:54.969569+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:20:54.969569+0000","last_undegraded":"2024-09-13T17:20:54.969569+0000","last_fullsized":"2024-09-13T17:20:54.969569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978286+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:20:54.978286+0000","last_peered":"2024-09-13T17:20:54.978286+0000","last_clean":"2024-09-13T17:20:54.978286+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:20:54.978286+0000","last_undegraded":"2024-09-13T17:20:54.978286+0000","last_fullsized":"2024-09-13T17:20:54.978286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966771+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:20:54.966771+0000","last_peered":"2024-09-13T17:20:54.966771+0000","last_clean":"2024-09-13T17:20:54.966771+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:20:54.966771+0000","last_undegraded":"2024-09-13T17:20:54.966771+0000","last_fullsized":"2024-09-13T17:20:54.966771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979791+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:20:54.979791+0000","last_peered":"2024-09-13T17:20:54.979791+0000","last_clean":"2024-09-13T17:20:54.979791+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:20:54.979791+0000","last_undegraded":"2024-09-13T17:20:54.979791+0000","last_fullsized":"2024-09-13T17:20:54.979791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969316+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:20:54.969316+0000","last_peered":"2024-09-13T17:20:54.969316+0000","last_clean":"2024-09-13T17:20:54.969316+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:20:54.969316+0000","last_undegraded":"2024-09-13T17:20:54.969316+0000","last_fullsized":"2024-09-13T17:20:54.969316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964475+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:20:54.964475+0000","last_peered":"2024-09-13T17:20:54.964475+0000","last_clean":"2024-09-13T17:20:54.964475+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:20:54.964475+0000","last_undegraded":"2024-09-13T17:20:54.964475+0000","last_fullsized":"2024-09-13T17:20:54.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970101+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:20:54.970101+0000","last_peered":"2024-09-13T17:20:54.970101+0000","last_clean":"2024-09-13T17:20:54.970101+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:20:54.970101+0000","last_undegraded":"2024-09-13T17:20:54.970101+0000","last_fullsized":"2024-09-13T17:20:54.970101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.963584+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:20:54.963584+0000","last_peered":"2024-09-13T17:20:54.963584+0000","last_clean":"2024-09-13T17:20:54.963584+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:20:54.963584+0000","last_undegraded":"2024-09-13T17:20:54.963584+0000","last_fullsized":"2024-09-13T17:20:54.963584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969472+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:20:54.969472+0000","last_peered":"2024-09-13T17:20:54.969472+0000","last_clean":"2024-09-13T17:20:54.969472+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:20:54.969472+0000","last_undegraded":"2024-09-13T17:20:54.969472+0000","last_fullsized":"2024-09-13T17:20:54.969472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978177+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:20:54.978177+0000","last_peered":"2024-09-13T17:20:54.978177+0000","last_clean":"2024-09-13T17:20:54.978177+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:20:54.978177+0000","last_undegraded":"2024-09-13T17:20:54.978177+0000","last_fullsized":"2024-09-13T17:20:54.978177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966978+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:20:54.966978+0000","last_peered":"2024-09-13T17:20:54.966978+0000","last_clean":"2024-09-13T17:20:54.966978+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:20:54.966978+0000","last_undegraded":"2024-09-13T17:20:54.966978+0000","last_fullsized":"2024-09-13T17:20:54.966978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197080+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:20:55.197080+0000","last_peered":"2024-09-13T17:20:55.197080+0000","last_clean":"2024-09-13T17:20:55.197080+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:20:55.197080+0000","last_undegraded":"2024-09-13T17:20:55.197080+0000","last_fullsized":"2024-09-13T17:20:55.197080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958011+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:20:54.958011+0000","last_peered":"2024-09-13T17:20:54.958011+0000","last_clean":"2024-09-13T17:20:54.958011+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:20:54.958011+0000","last_undegraded":"2024-09-13T17:20:54.958011+0000","last_fullsized":"2024-09-13T17:20:54.958011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:03.506249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975939+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:20:54.975939+0000","last_peered":"2024-09-13T17:20:54.975939+0000","last_clean":"2024-09-13T17:20:54.975939+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:20:54.975939+0000","last_undegraded":"2024-09-13T17:20:54.975939+0000","last_fullsized":"2024-09-13T17:20:54.975939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969955+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:20:54.969955+0000","last_peered":"2024-09-13T17:20:54.969955+0000","last_clean":"2024-09-13T17:20:54.969955+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:20:54.969955+0000","last_undegraded":"2024-09-13T17:20:54.969955+0000","last_fullsized":"2024-09-13T17:20:54.969955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978607+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:20:54.978607+0000","last_peered":"2024-09-13T17:20:54.978607+0000","last_clean":"2024-09-13T17:20:54.978607+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:20:54.978607+0000","last_undegraded":"2024-09-13T17:20:54.978607+0000","last_fullsized":"2024-09-13T17:20:54.978607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979908+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:20:54.979908+0000","last_peered":"2024-09-13T17:20:54.979908+0000","last_clean":"2024-09-13T17:20:54.979908+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:20:54.979908+0000","last_undegraded":"2024-09-13T17:20:54.979908+0000","last_fullsized":"2024-09-13T17:20:54.979908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961659+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:20:54.961659+0000","last_peered":"2024-09-13T17:20:54.961659+0000","last_clean":"2024-09-13T17:20:54.961659+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:20:54.961659+0000","last_undegraded":"2024-09-13T17:20:54.961659+0000","last_fullsized":"2024-09-13T17:20:54.961659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977776+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:20:54.977776+0000","last_peered":"2024-09-13T17:20:54.977776+0000","last_clean":"2024-09-13T17:20:54.977776+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:20:54.977776+0000","last_undegraded":"2024-09-13T17:20:54.977776+0000","last_fullsized":"2024-09-13T17:20:54.977776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967718+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:20:54.967718+0000","last_peered":"2024-09-13T17:20:54.967718+0000","last_clean":"2024-09-13T17:20:54.967718+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:20:54.967718+0000","last_undegraded":"2024-09-13T17:20:54.967718+0000","last_fullsized":"2024-09-13T17:20:54.967718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969097+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:20:54.969097+0000","last_peered":"2024-09-13T17:20:54.969097+0000","last_clean":"2024-09-13T17:20:54.969097+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:20:54.969097+0000","last_undegraded":"2024-09-13T17:20:54.969097+0000","last_fullsized":"2024-09-13T17:20:54.969097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196836+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:20:55.196836+0000","last_peered":"2024-09-13T17:20:55.196836+0000","last_clean":"2024-09-13T17:20:55.196836+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:20:55.196836+0000","last_undegraded":"2024-09-13T17:20:55.196836+0000","last_fullsized":"2024-09-13T17:20:55.196836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964372+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:20:54.964372+0000","last_peered":"2024-09-13T17:20:54.964372+0000","last_clean":"2024-09-13T17:20:54.964372+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:20:54.964372+0000","last_undegraded":"2024-09-13T17:20:54.964372+0000","last_fullsized":"2024-09-13T17:20:54.964372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187418+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:20:55.187418+0000","last_peered":"2024-09-13T17:20:55.187418+0000","last_clean":"2024-09-13T17:20:55.187418+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:20:55.187418+0000","last_undegraded":"2024-09-13T17:20:55.187418+0000","last_fullsized":"2024-09-13T17:20:55.187418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969378+0000","last_change":"2024-09-13T17:20:50.961962+0000","last_active":"2024-09-13T17:20:54.969378+0000","last_peered":"2024-09-13T17:20:54.969378+0000","last_clean":"2024-09-13T17:20:54.969378+0000","last_became_active":"2024-09-13T17:20:50.959714+0000","last_became_peered":"2024-09-13T17:20:50.959714+0000","last_unstale":"2024-09-13T17:20:54.969378+0000","last_undegraded":"2024-09-13T17:20:54.969378+0000","last_fullsized":"2024-09-13T17:20:54.969378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.191758+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:20:55.191758+0000","last_peered":"2024-09-13T17:20:55.191758+0000","last_clean":"2024-09-13T17:20:55.191758+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:20:55.191758+0000","last_undegraded":"2024-09-13T17:20:55.191758+0000","last_fullsized":"2024-09-13T17:20:55.191758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973023+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:20:54.973023+0000","last_peered":"2024-09-13T17:20:54.973023+0000","last_clean":"2024-09-13T17:20:54.973023+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:20:54.973023+0000","last_undegraded":"2024-09-13T17:20:54.973023+0000","last_fullsized":"2024-09-13T17:20:54.973023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980339+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:20:54.980339+0000","last_peered":"2024-09-13T17:20:54.980339+0000","last_clean":"2024-09-13T17:20:54.980339+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:20:54.980339+0000","last_undegraded":"2024-09-13T17:20:54.980339+0000","last_fullsized":"2024-09-13T17:20:54.980339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980100+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:20:54.980100+0000","last_peered":"2024-09-13T17:20:54.980100+0000","last_clean":"2024-09-13T17:20:54.980100+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:20:54.980100+0000","last_undegraded":"2024-09-13T17:20:54.980100+0000","last_fullsized":"2024-09-13T17:20:54.980100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196594+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:20:55.196594+0000","last_peered":"2024-09-13T17:20:55.196594+0000","last_clean":"2024-09-13T17:20:55.196594+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:20:55.196594+0000","last_undegraded":"2024-09-13T17:20:55.196594+0000","last_fullsized":"2024-09-13T17:20:55.196594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":701079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:21:15.005 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:21:15.006 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T17:21:15.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T17:21:15.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T17:21:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T17:21:15.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf496ed640 1 Processor -- start 2024-09-13T17:21:15.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf496ed640 1 -- start start 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf496ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 0x7fcf440b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf496ed640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcf4413d220 0x7fcf4413d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf496ed640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf440b05f0 con 0x7fcf44146ca0 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf496ed640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440b3210 con 0x7fcf4413d220 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf496ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44071fe0 con 0x7fcf44071c00 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf3bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcf44146ca0 0x7fcf441470e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46970/0 (socket says 172.21.15.167:46970) 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf3bfff640 1 -- 172.21.15.167:0/1121978179 learned_addr learned my addr 172.21.15.167:0/1121978179 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 0x7fcf440b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf437fe640 1 --2- 172.21.15.167:0/1121978179 >> v2:172.21.15.190:3300/0 conn(0x7fcf4413d220 0x7fcf4413d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967331714 0 0) 0x7fcf440b05f0 con 0x7fcf44146ca0 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.162+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf30003530 con 0x7fcf44146ca0 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3099990009 0 0) 0x7fcf30003530 con 0x7fcf44146ca0 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 msgr2=0x7fcf440b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 0x7fcf440b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 >> v2:172.21.15.190:3300/0 conn(0x7fcf4413d220 msgr2=0x7fcf4413d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 --2- 172.21.15.167:0/1121978179 >> v2:172.21.15.190:3300/0 conn(0x7fcf4413d220 0x7fcf4413d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf440b34b0 con 0x7fcf44146ca0 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fcf2c001680 con 0x7fcf44146ca0 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 >> v1:172.21.15.167:6789/0 conn(0x7fcf44146ca0 legacy=0x7fcf441470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf30003980 0x7fcf30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 0x7fcf300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf30004d10 0x7fcf30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440b3210 con 0x7fcf30003980 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44071fe0 con 0x7fcf30004d10 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3000b990 con 0x7fcf44071c00 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf30003980 0x7fcf30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf3bfff640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 0x7fcf300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf437fe640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf30004d10 0x7fcf30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf42ffd640 1 -- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 msgr2=0x7fcf300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 0x7fcf300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf42ffd640 1 -- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf30004d10 msgr2=0x7fcf30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf30004d10 0x7fcf30005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf42ffd640 1 -- 172.21.15.167:0/1121978179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30003530 con 0x7fcf30003980 2024-09-13T17:21:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf3bfff640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf44071c00 0x7fcf300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:15.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf30003980 0x7fcf30003da0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009ae0 tx=0x7fcf3401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5647e4c1bd748a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340a64d0 con 0x7fcf30003980 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf340a6630 con 0x7fcf30003980 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf427fc640 1 -- 172.21.15.167:0/1121978179 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340a69e0 con 0x7fcf30003980 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf496ed640 1 -- 172.21.15.167:0/1121978179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf30003980 msgr2=0x7fcf30003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf496ed640 1 --2- 172.21.15.167:0/1121978179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf30003980 0x7fcf30003da0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009ae0 tx=0x7fcf3401ca70 comp rx=0 tx=0).stop 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf437fe640 1 -- 172.21.15.167:0/1121978179 reap_dead start 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf496ed640 1 -- 172.21.15.167:0/1121978179 shutdown_connections 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf496ed640 1 -- 172.21.15.167:0/1121978179 >> 172.21.15.167:0/1121978179 conn(0x7fcf440b8260 msgr2=0x7fcf440b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf496ed640 1 -- 172.21.15.167:0/1121978179 shutdown_connections 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.166+0000 7fcf496ed640 1 -- 172.21.15.167:0/1121978179 wait complete. 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 Processor -- start 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 -- start start 2024-09-13T17:21:15.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf30003980 0x7fcf441396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf441467f0 0x7fcf441384f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44138a30 0x7fcf441df560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441df110 con 0x7fcf441467f0 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44138eb0 con 0x7fcf44138a30 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4414b760 con 0x7fcf30003980 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf441467f0 0x7fcf441384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf441467f0 0x7fcf441384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42260/0 (socket says 172.21.15.167:42260) 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 -- 172.21.15.167:0/1944459965 learned_addr learned my addr 172.21.15.167:0/1944459965 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf30003980 0x7fcf441396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf437fe640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44138a30 0x7fcf441df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 -- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf30003980 msgr2=0x7fcf441396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf30003980 0x7fcf441396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 -- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44138a30 msgr2=0x7fcf441df560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44138a30 0x7fcf441df560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 -- 172.21.15.167:0/1944459965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4414b1a0 con 0x7fcf441467f0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3bfff640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf441467f0 0x7fcf441384f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00d780 tx=0x7fcf2c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3b7fe640 1 -- 172.21.15.167:0/1944459965 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0074e0 con 0x7fcf441467f0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3b7fe640 1 -- 172.21.15.167:0/1944459965 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00de90 con 0x7fcf441467f0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4414b480 con 0x7fcf441467f0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3b7fe640 1 -- 172.21.15.167:0/1944459965 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0049f0 con 0x7fcf441467f0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf44140fe0 con 0x7fcf441467f0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4413d650 con 0x7fcf441467f0 2024-09-13T17:21:15.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.170+0000 7fcf3b7fe640 1 -- 172.21.15.167:0/1944459965 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf2c004b50 con 0x7fcf441467f0 2024-09-13T17:21:15.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.174+0000 7fcf3b7fe640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcf24066690 0x7fcf24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.174+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcf24066690 0x7fcf24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.174+0000 7fcf3b7fe640 1 -- 172.21.15.167:0/1944459965 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf2c0840a0 con 0x7fcf441467f0 2024-09-13T17:21:15.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.174+0000 7fcf42ffd640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcf24066690 0x7fcf24068b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf340af000 tx=0x7fcf340046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.178+0000 7fcf3b7fe640 1 -- 172.21.15.167:0/1944459965 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf2c0511b0 con 0x7fcf441467f0 2024-09-13T17:21:15.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.374+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcf441418d0 con 0x7fcf441467f0 2024-09-13T17:21:15.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.378+0000 7fcf3b7fe640 1 -- 172.21.15.167:0/1944459965 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164905 (secure 0 0 0) 0x7fcf2c0547d0 con 0x7fcf441467f0 2024-09-13T17:21:15.384 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcf24066690 msgr2=0x7fcf24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcf24066690 0x7fcf24068b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf340af000 tx=0x7fcf340046d0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf441467f0 msgr2=0x7fcf441384f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf441467f0 0x7fcf441384f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00d780 tx=0x7fcf2c00dc40 comp rx=0 tx=0).stop 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 shutdown_connections 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcf24066690 0x7fcf24068b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcf44138a30 0x7fcf441df560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf441467f0 0x7fcf441384f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 --2- 172.21.15.167:0/1944459965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcf30003980 0x7fcf441396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 >> 172.21.15.167:0/1944459965 conn(0x7fcf440b8260 msgr2=0x7fcf44141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 shutdown_connections 2024-09-13T17:21:15.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.382+0000 7fcf496ed640 1 -- 172.21.15.167:0/1944459965 wait complete. 2024-09-13T17:21:15.402 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1477469698},{"type":"v1","addr":"172.21.15.167:6833","nonce":1477469698}]},"active_addr":"172.21.15.167:6833/1477469698","active_change":"2024-09-13T17:20:31.481765+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":794439763}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":785495995}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":1588239962}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":1723665849}]}]} 2024-09-13T17:21:15.406 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T17:21:15.407 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T17:21:15.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:15.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.514+0000 7fd5d6e01640 1 Processor -- start 2024-09-13T17:21:15.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.514+0000 7fd5d6e01640 1 -- start start 2024-09-13T17:21:15.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d6e01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 0x7fd5d0141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d6e01640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd5d0072180 0x7fd5d00b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d6e01640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d01454d0 con 0x7fd5d0145fb0 2024-09-13T17:21:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d6e01640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d006ee70 con 0x7fd5d0072180 2024-09-13T17:21:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d6e01640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01422f0 con 0x7fd5d013c260 2024-09-13T17:21:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d539e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd5d0145fb0 0x7fd5d00aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46986/0 (socket says 172.21.15.167:46986) 2024-09-13T17:21:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d539e640 1 -- 172.21.15.167:0/1301936865 learned_addr learned my addr 172.21.15.167:0/1301936865 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 0x7fd5d0141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576865596 0 0) 0x7fd5d01454d0 con 0x7fd5d0145fb0 2024-09-13T17:21:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b8004640 con 0x7fd5d0145fb0 2024-09-13T17:21:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cffff640 1 --2- 172.21.15.167:0/1301936865 >> v2:172.21.15.190:3300/0 conn(0x7fd5d0072180 0x7fd5d00b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645115675 0 0) 0x7fd5b8004640 con 0x7fd5d0145fb0 2024-09-13T17:21:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 msgr2=0x7fd5d0141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 0x7fd5d0141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 >> v2:172.21.15.190:3300/0 conn(0x7fd5d0072180 msgr2=0x7fd5d00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 --2- 172.21.15.167:0/1301936865 >> v2:172.21.15.190:3300/0 conn(0x7fd5d0072180 0x7fd5d00b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d01457b0 con 0x7fd5d0145fb0 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fd5c8001a00 con 0x7fd5d0145fb0 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cffff640 1 --2- 172.21.15.167:0/1301936865 >> v2:172.21.15.190:3300/0 conn(0x7fd5d0072180 0x7fd5d00b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 >> v1:172.21.15.167:6789/0 conn(0x7fd5d0145fb0 legacy=0x7fd5d00aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5b8004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5b80058e0 0x7fd5b8005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 0x7fd5b80062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b800cb50 con 0x7fd5b8004a90 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b800cc90 con 0x7fd5b80058e0 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b800ce50 con 0x7fd5d013c260 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5b8004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d539e640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 0x7fd5b80062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cffff640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5b80058e0 0x7fd5b8005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d4b9d640 1 -- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 msgr2=0x7fd5b80062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 0x7fd5b80062a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d4b9d640 1 -- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5b80058e0 msgr2=0x7fd5b8005d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5b80058e0 0x7fd5b8005d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d4b9d640 1 -- 172.21.15.167:0/1301936865 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8004640 con 0x7fd5b8004a90 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5cffff640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5b80058e0 0x7fd5b8005d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.518+0000 7fd5d539e640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d013c260 0x7fd5b80062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:15.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5b8004eb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009ae0 tx=0x7fd5c001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a14d2f1b1f832f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00a6450 con 0x7fd5b8004a90 2024-09-13T17:21:15.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c00a65b0 con 0x7fd5b8004a90 2024-09-13T17:21:15.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5cf7fe640 1 -- 172.21.15.167:0/1301936865 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00a6960 con 0x7fd5b8004a90 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- 172.21.15.167:0/1301936865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 msgr2=0x7fd5b8004eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 --2- 172.21.15.167:0/1301936865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5b8004eb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009ae0 tx=0x7fd5c001ca70 comp rx=0 tx=0).stop 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d539e640 1 -- 172.21.15.167:0/1301936865 reap_dead start 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- 172.21.15.167:0/1301936865 shutdown_connections 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- 172.21.15.167:0/1301936865 >> 172.21.15.167:0/1301936865 conn(0x7fd5d00b7250 msgr2=0x7fd5d00b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- 172.21.15.167:0/1301936865 shutdown_connections 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- 172.21.15.167:0/1301936865 wait complete. 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 Processor -- start 2024-09-13T17:21:15.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- start start 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5d013e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5d0144b20 0x7fd5d01e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d0144fa0 0x7fd5d01e2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0144690 con 0x7fd5b8004a90 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00ade00 con 0x7fd5d0144b20 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00ad970 con 0x7fd5d0144fa0 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5d013e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5d013e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42288/0 (socket says 172.21.15.167:42288) 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 -- 172.21.15.167:0/3913326263 learned_addr learned my addr 172.21.15.167:0/3913326263 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5cffff640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5d0144b20 0x7fd5d01e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d539e640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d0144fa0 0x7fd5d01e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 -- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d0144fa0 msgr2=0x7fd5d01e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d0144fa0 0x7fd5d01e2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 -- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5d0144b20 msgr2=0x7fd5d01e1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5d0144b20 0x7fd5d01e1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 -- 172.21.15.167:0/3913326263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d00ae070 con 0x7fd5b8004a90 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d4b9d640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5d013e660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5c001cf50 tx=0x7fd5b8006910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5cd7fa640 1 -- 172.21.15.167:0/3913326263 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00a6720 con 0x7fd5b8004a90 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5cd7fa640 1 -- 172.21.15.167:0/3913326263 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000f000 con 0x7fd5b8004a90 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d00ae350 con 0x7fd5b8004a90 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5cd7fa640 1 -- 172.21.15.167:0/3913326263 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00a7670 con 0x7fd5b8004a90 2024-09-13T17:21:15.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.522+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d00ab8c0 con 0x7fd5b8004a90 2024-09-13T17:21:15.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.526+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d01454d0 con 0x7fd5b8004a90 2024-09-13T17:21:15.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.526+0000 7fd5cd7fa640 1 -- 172.21.15.167:0/3913326263 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5c00a77d0 con 0x7fd5b8004a90 2024-09-13T17:21:15.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.526+0000 7fd5cd7fa640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5bc066690 0x7fd5bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.526+0000 7fd5cd7fa640 1 -- 172.21.15.167:0/3913326263 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5c011de20 con 0x7fd5b8004a90 2024-09-13T17:21:15.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.526+0000 7fd5cffff640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5bc066690 0x7fd5bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.526+0000 7fd5cffff640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5bc066690 0x7fd5bc068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5d013fcf0 tx=0x7fd5c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.530+0000 7fd5cd7fa640 1 -- 172.21.15.167:0/3913326263 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5c00eaf30 con 0x7fd5b8004a90 2024-09-13T17:21:15.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.682+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5d0140670 con 0x7fd5b8004a90 2024-09-13T17:21:15.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5cd7fa640 1 -- 172.21.15.167:0/3913326263 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fd5c00be070 con 0x7fd5b8004a90 2024-09-13T17:21:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:15.689 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5bc066690 msgr2=0x7fd5bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5bc066690 0x7fd5bc068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5d013fcf0 tx=0x7fd5c4008040 comp rx=0 tx=0).stop 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 msgr2=0x7fd5d013e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5d013e660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5c001cf50 tx=0x7fd5b8006910 comp rx=0 tx=0).stop 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 shutdown_connections 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5bc066690 0x7fd5bc068b50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5d0144fa0 0x7fd5d01e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5d0144b20 0x7fd5d01e1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 --2- 172.21.15.167:0/3913326263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b8004a90 0x7fd5d013e660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 >> 172.21.15.167:0/3913326263 conn(0x7fd5d00b7250 msgr2=0x7fd5d00ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 shutdown_connections 2024-09-13T17:21:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.686+0000 7fd5d6e01640 1 -- 172.21.15.167:0/3913326263 wait complete. 2024-09-13T17:21:15.706 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T17:21:15.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:15.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59ed2ba640 1 Processor -- start 2024-09-13T17:21:15.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59ed2ba640 1 -- start start 2024-09-13T17:21:15.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59ed2ba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f59e80722f0 0x7f59e8143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59ed2ba640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e80707d0 con 0x7f59e8144520 2024-09-13T17:21:15.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59ed2ba640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e80b45f0 con 0x7f59e80b4210 2024-09-13T17:21:15.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59ed2ba640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e81438f0 con 0x7f59e80722f0 2024-09-13T17:21:15.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e67fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f59e80722f0 0x7f59e8143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f59e8144520 0x7f59e8140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46992/0 (socket says 172.21.15.167:46992) 2024-09-13T17:21:15.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e67fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f59e80722f0 0x7f59e8143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42300/0 (socket says 172.21.15.167:42300) 2024-09-13T17:21:15.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e77fe640 1 -- 172.21.15.167:0/3433767438 learned_addr learned my addr 172.21.15.167:0/3433767438 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:15.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e67fc640 1 -- 172.21.15.167:0/3433767438 >> v1:172.21.15.190:6789/0 conn(0x7f59e80b4210 legacy=0x7f59e806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:15.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e67fc640 1 -- 172.21.15.167:0/3433767438 >> v1:172.21.15.167:6789/0 conn(0x7f59e8144520 legacy=0x7f59e8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e67fc640 1 -- 172.21.15.167:0/3433767438 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e806dd80 con 0x7f59e80722f0 2024-09-13T17:21:15.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.814+0000 7f59e5ffb640 1 -- 172.21.15.167:0/3433767438 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063116404 0 0) 0x7f59e80707d0 con 0x7f59e8144520 2024-09-13T17:21:15.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 --2- 172.21.15.167:0/3433767438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80722f0 0x7f59e8143fe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59e8143a30 tx=0x7f59dc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c380da4ff2f96427 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e5ffb640 1 -- 172.21.15.167:0/3433767438 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0ab600 con 0x7f59e80722f0 2024-09-13T17:21:15.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e5ffb640 1 -- 172.21.15.167:0/3433767438 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc0a7050 con 0x7f59e80722f0 2024-09-13T17:21:15.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e5ffb640 1 -- 172.21.15.167:0/3433767438 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0ab980 con 0x7f59e80722f0 2024-09-13T17:21:15.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- 172.21.15.167:0/3433767438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80722f0 msgr2=0x7f59e8143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/3433767438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80722f0 0x7f59e8143fe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59e8143a30 tx=0x7f59dc01c3d0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- 172.21.15.167:0/3433767438 shutdown_connections 2024-09-13T17:21:15.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/3433767438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80722f0 0x7f59e8143fe0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- 172.21.15.167:0/3433767438 >> 172.21.15.167:0/3433767438 conn(0x7f59e809b150 msgr2=0x7f59e809b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:15.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- 172.21.15.167:0/3433767438 shutdown_connections 2024-09-13T17:21:15.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- 172.21.15.167:0/3433767438 wait complete. 2024-09-13T17:21:15.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 Processor -- start 2024-09-13T17:21:15.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- start start 2024-09-13T17:21:15.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80722f0 0x7f59e809f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80b4210 0x7f59e809c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e8144520 0x7f59e80af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e813d320 con 0x7f59e80b4210 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e809c990 con 0x7f59e8144520 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80af5c0 con 0x7f59e80722f0 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80b4210 0x7f59e809c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80b4210 0x7f59e809c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42308/0 (socket says 172.21.15.167:42308) 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 -- 172.21.15.167:0/141707761 learned_addr learned my addr 172.21.15.167:0/141707761 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 -- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80722f0 msgr2=0x7f59e809f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e6ffd640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80722f0 0x7f59e809f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e77fe640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e8144520 0x7f59e80af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80722f0 0x7f59e809f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 -- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e8144520 msgr2=0x7f59e80af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e8144520 0x7f59e80af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 -- 172.21.15.167:0/141707761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc009420 con 0x7f59e80b4210 2024-09-13T17:21:15.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59e67fc640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80b4210 0x7f59e809c450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59dc01a000 tx=0x7f59dc01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59cf7fe640 1 -- 172.21.15.167:0/141707761 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0b7860 con 0x7f59e80b4210 2024-09-13T17:21:15.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59cf7fe640 1 -- 172.21.15.167:0/141707761 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc0b79e0 con 0x7f59e80b4210 2024-09-13T17:21:15.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e80af840 con 0x7f59e80b4210 2024-09-13T17:21:15.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59cf7fe640 1 -- 172.21.15.167:0/141707761 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0b7d90 con 0x7f59e80b4210 2024-09-13T17:21:15.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.818+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e80ae8b0 con 0x7f59e80b4210 2024-09-13T17:21:15.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.822+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e8143fe0 con 0x7f59e80b4210 2024-09-13T17:21:15.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.822+0000 7f59cf7fe640 1 -- 172.21.15.167:0/141707761 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59dc0b5400 con 0x7f59e80b4210 2024-09-13T17:21:15.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.822+0000 7f59cf7fe640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f59d4066690 0x7f59d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:15.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.822+0000 7f59cf7fe640 1 -- 172.21.15.167:0/141707761 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59dc11f000 con 0x7f59e80b4210 2024-09-13T17:21:15.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.822+0000 7f59e6ffd640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f59d4066690 0x7f59d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:15.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.822+0000 7f59e6ffd640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f59d4066690 0x7f59d4068b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59d8003d60 tx=0x7f59d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:15.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.826+0000 7f59cf7fe640 1 -- 172.21.15.167:0/141707761 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59dc0ec110 con 0x7f59e80b4210 2024-09-13T17:21:15.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.982+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59e813e900 con 0x7f59e80b4210 2024-09-13T17:21:15.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59cf7fe640 1 -- 172.21.15.167:0/141707761 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f59dc0ef730 con 0x7f59e80b4210 2024-09-13T17:21:15.988 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:15.988 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f59d4066690 msgr2=0x7f59d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f59d4066690 0x7f59d4068b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59d8003d60 tx=0x7f59d8009040 comp rx=0 tx=0).stop 2024-09-13T17:21:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80b4210 msgr2=0x7f59e809c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80b4210 0x7f59e809c450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59dc01a000 tx=0x7f59dc01ac10 comp rx=0 tx=0).stop 2024-09-13T17:21:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 shutdown_connections 2024-09-13T17:21:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f59d4066690 0x7f59d4068b50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e8144520 0x7f59e80af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e80b4210 0x7f59e809c450 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 --2- 172.21.15.167:0/141707761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80722f0 0x7f59e809f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 >> 172.21.15.167:0/141707761 conn(0x7f59e809b150 msgr2=0x7f59e8142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 shutdown_connections 2024-09-13T17:21:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:15.986+0000 7f59ed2ba640 1 -- 172.21.15.167:0/141707761 wait complete. 2024-09-13T17:21:16.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T17:21:16.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T17:21:16.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T17:21:16.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T17:21:16.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T17:21:16.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T17:21:16.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T17:21:16.008 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T17:21:16.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7fd5d03aa640 1 Processor -- start 2024-09-13T17:21:16.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7fd5d03aa640 1 -- start start 2024-09-13T17:21:16.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7f2feccb1640 1 Processor -- start 2024-09-13T17:21:16.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7f2feccb1640 1 -- start start 2024-09-13T17:21:16.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7fd5d03aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd5c806b380 0x7fd5c8141e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7fd5d03aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c8142370 0x7fd5c8142800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7fd5d03aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80ac730 con 0x7fd5c806ab10 2024-09-13T17:21:16.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7fd5d03aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80ac1e0 con 0x7fd5c806b380 2024-09-13T17:21:16.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7fd5d03aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80ad5b0 con 0x7fd5c8142370 2024-09-13T17:21:16.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.178+0000 7f5582e90640 1 Processor -- start 2024-09-13T17:21:16.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f5582e90640 1 -- start start 2024-09-13T17:21:16.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2feccb1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2fe806b640 0x7f2fe8146e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2feccb1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2fe814d990 0x7f2fe8154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2feccb1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe80b1cc0 con 0x7f2fe81473d0 2024-09-13T17:21:16.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5cd945640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd5c806b380 0x7fd5c8141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5ce947640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c8142370 0x7fd5c8142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5ce947640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c8142370 0x7fd5c8142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.167:38224/0 (socket says 172.21.15.167:38224) 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5ce947640 1 -- 172.21.15.167:0/1064045345 learned_addr learned my addr 172.21.15.167:0/1064045345 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2feccb1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80b2ad0 con 0x7f2fe806b640 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2feccb1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe81477f0 con 0x7f2fe814d990 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2fe659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2fe806b640 0x7f2fe8146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2fe659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2fe806b640 0x7f2fe8146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42312/0 (socket says 172.21.15.167:42312) 2024-09-13T17:21:16.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2fe659c640 1 -- 172.21.15.167:0/933192207 learned_addr learned my addr 172.21.15.167:0/933192207 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7792e7d640 1 Processor -- start 2024-09-13T17:21:16.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7792e7d640 1 -- start start 2024-09-13T17:21:16.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5ce947640 1 -- 172.21.15.167:0/1064045345 >> v2:172.21.15.190:3300/0 conn(0x7fd5c806b380 msgr2=0x7fd5c8141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5ce947640 1 --2- 172.21.15.167:0/1064045345 >> v2:172.21.15.190:3300/0 conn(0x7fd5c806b380 0x7fd5c8141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5ce947640 1 -- 172.21.15.167:0/1064045345 >> v1:172.21.15.190:6789/0 conn(0x7fd5c806ab10 legacy=0x7fd5c80acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fd5ce947640 1 -- 172.21.15.167:0/1064045345 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80b1bc0 con 0x7fd5c8142370 2024-09-13T17:21:16.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e970640 1 Processor -- start 2024-09-13T17:21:16.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e970640 1 -- start start 2024-09-13T17:21:16.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f5582e90640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f557c099f20 0x7f557c06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f5582e90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f557c06a0a0 0x7f557c148e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f5582e90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a4f0 0x7f557c149380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f5582e90640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c0b6280 con 0x7f557c06a0a0 2024-09-13T17:21:16.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f5582e90640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c06b180 con 0x7f557c099f20 2024-09-13T17:21:16.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f5582e90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b5ee0 con 0x7f557c06a4f0 2024-09-13T17:21:16.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f557c06a0a0 0x7f557c148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f557c06a0a0 0x7f557c148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42326/0 (socket says 172.21.15.167:42326) 2024-09-13T17:21:16.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 -- 172.21.15.167:0/1367664388 learned_addr learned my addr 172.21.15.167:0/1367664388 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 -- 172.21.15.167:0/1367664388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a4f0 msgr2=0x7f557c149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 --2- 172.21.15.167:0/1367664388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a4f0 0x7f557c149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 -- 172.21.15.167:0/1367664388 >> v2:172.21.15.190:3300/0 conn(0x7f557c099f20 msgr2=0x7f557c06ab60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:21:16.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 --2- 172.21.15.167:0/1367664388 >> v2:172.21.15.190:3300/0 conn(0x7f557c099f20 0x7f557c06ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f558168d640 1 -- 172.21.15.167:0/1367664388 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0baf10 con 0x7f557c06a0a0 2024-09-13T17:21:16.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2fe659c640 1 -- 172.21.15.167:0/933192207 >> v2:172.21.15.190:3300/0 conn(0x7f2fe814d990 msgr2=0x7f2fe8154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2fe659c640 1 --2- 172.21.15.167:0/933192207 >> v2:172.21.15.190:3300/0 conn(0x7f2fe814d990 0x7f2fe8154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2fe659c640 1 -- 172.21.15.167:0/933192207 >> v1:172.21.15.190:6789/0 conn(0x7f2fe81473d0 legacy=0x7f2fe814d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e970640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d900084b0 0x7f3d90007710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e970640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900c8ea0 0x7f3d900c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e970640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d90008020 con 0x7f3d9000be00 2024-09-13T17:21:16.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e970640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9001d520 con 0x7f3d900084b0 2024-09-13T17:21:16.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e970640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9000c1e0 con 0x7f3d900c8ea0 2024-09-13T17:21:16.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f2fe659c640 1 -- 172.21.15.167:0/933192207 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe80b1a20 con 0x7f2fe806b640 2024-09-13T17:21:16.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9d16d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d900084b0 0x7f3d90007710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9d16d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d900084b0 0x7f3d90007710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42342/0 (socket says 172.21.15.167:42342) 2024-09-13T17:21:16.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9d16d640 1 -- 172.21.15.167:0/2510416045 learned_addr learned my addr 172.21.15.167:0/2510416045 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9d16d640 1 -- 172.21.15.167:0/2510416045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900c8ea0 msgr2=0x7f3d900c9350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:21:16.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9e16f640 1 --2- 172.21.15.167:0/2510416045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900c8ea0 0x7f3d900c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9d16d640 1 --2- 172.21.15.167:0/2510416045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900c8ea0 0x7f3d900c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7792e7d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f778401cef0 0x7f7784006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9d16d640 1 -- 172.21.15.167:0/2510416045 >> v1:172.21.15.167:6789/0 conn(0x7f3d9000be00 legacy=0x7f3d9001d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7792e7d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 0x7f77840386f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7792e7d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840c9000 con 0x7f77840c9490 2024-09-13T17:21:16.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7792e7d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778401b3c0 con 0x7f778401cef0 2024-09-13T17:21:16.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7792e7d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77840c8cb0 con 0x7f7784020410 2024-09-13T17:21:16.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7790c19640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f778401cef0 0x7f7784006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7790c19640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f778401cef0 0x7f7784006040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41056/0 (socket says 172.21.15.167:41056) 2024-09-13T17:21:16.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f7790c19640 1 -- 172.21.15.167:0/4175687082 learned_addr learned my addr 172.21.15.167:0/4175687082 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f779141a640 1 --2- 172.21.15.167:0/4175687082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 0x7f77840386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f3d9d16d640 1 -- 172.21.15.167:0/2510416045 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90008cb0 con 0x7f3d900084b0 2024-09-13T17:21:16.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f779141a640 1 -- 172.21.15.167:0/4175687082 >> v2:172.21.15.190:3300/0 conn(0x7f778401cef0 msgr2=0x7f7784006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f779141a640 1 --2- 172.21.15.167:0/4175687082 >> v2:172.21.15.190:3300/0 conn(0x7f778401cef0 0x7f7784006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f779141a640 1 -- 172.21.15.167:0/4175687082 >> v1:172.21.15.190:6789/0 conn(0x7f77840c9490 legacy=0x7f778401fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f779141a640 1 -- 172.21.15.167:0/4175687082 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778401e460 con 0x7f7784020410 2024-09-13T17:21:16.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f9f6484e640 1 Processor -- start 2024-09-13T17:21:16.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7f9f6484e640 1 -- start start 2024-09-13T17:21:16.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5ce947640 1 --2- 172.21.15.167:0/1064045345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c8142370 0x7fd5c8142800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009870 tx=0x7fd5b801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5adc3030f2e372 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2fe659c640 1 --2- 172.21.15.167:0/933192207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe806b640 0x7f2fe8146e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2fe814e1b0 tx=0x7f2fd801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3522dbd832940fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5cd144640 1 -- 172.21.15.167:0/1064045345 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80ab600 con 0x7fd5c8142370 2024-09-13T17:21:16.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5cd144640 1 -- 172.21.15.167:0/1064045345 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b80a7050 con 0x7fd5c8142370 2024-09-13T17:21:16.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5cd144640 1 -- 172.21.15.167:0/1064045345 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80ab980 con 0x7fd5c8142370 2024-09-13T17:21:16.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fef9759e640 1 Processor -- start 2024-09-13T17:21:16.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.182+0000 7fef9759e640 1 -- start start 2024-09-13T17:21:16.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9759e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef9003b9b0 0x7fef9001c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900202c0 0x7fef9001c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9759e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9001e3a0 con 0x7fef9001bbf0 2024-09-13T17:21:16.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9759e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef90020730 con 0x7fef9003b9b0 2024-09-13T17:21:16.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9001d570 con 0x7fef900202c0 2024-09-13T17:21:16.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f558168d640 1 --2- 172.21.15.167:0/1367664388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a0a0 0x7f557c148e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f557c0677a0 tx=0x7f556c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9f6caf26b657ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef9003b9b0 0x7fef9001c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef9003b9b0 0x7fef9001c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41060/0 (socket says 172.21.15.167:41060) 2024-09-13T17:21:16.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9659c640 1 -- 172.21.15.167:0/1064826732 learned_addr learned my addr 172.21.15.167:0/1064826732 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5580e8c640 1 -- 172.21.15.167:0/1367664388 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c0ac630 con 0x7f557c06a0a0 2024-09-13T17:21:16.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9d16d640 1 --2- 172.21.15.167:0/2510416045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900084b0 0x7f3d90007710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d98074040 tx=0x7f3d98096720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceacea583a0d8d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 -- 172.21.15.167:0/1064045345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c8142370 msgr2=0x7fd5c8142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 --2- 172.21.15.167:0/1064045345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c8142370 0x7fd5c8142800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009870 tx=0x7fd5b801c380 comp rx=0 tx=0).stop 2024-09-13T17:21:16.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2fe559a640 1 -- 172.21.15.167:0/933192207 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80ad680 con 0x7f2fe806b640 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2fe559a640 1 -- 172.21.15.167:0/933192207 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80ad7e0 con 0x7f2fe806b640 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2fe559a640 1 -- 172.21.15.167:0/933192207 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80adb70 con 0x7f2fe806b640 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 -- 172.21.15.167:0/933192207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe806b640 msgr2=0x7f2fe8146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 --2- 172.21.15.167:0/933192207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe806b640 0x7f2fe8146e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2fe814e1b0 tx=0x7f2fd801c4d0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 -- 172.21.15.167:0/933192207 shutdown_connections 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 --2- 172.21.15.167:0/933192207 >> v2:172.21.15.190:3300/0 conn(0x7f2fe814d990 0x7f2fe8154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 --2- 172.21.15.167:0/933192207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe806b640 0x7f2fe8146e90 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2fe814e1b0 tx=0x7f2fd801c4d0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 -- 172.21.15.167:0/933192207 >> 172.21.15.167:0/933192207 conn(0x7f2fe80b7420 msgr2=0x7f2fe80b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f6484e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9f600adc70 0x7f9f60099670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f6484e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f60142080 0x7f9f601424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5580e8c640 1 -- 172.21.15.167:0/1367664388 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c0ac790 con 0x7f557c06a0a0 2024-09-13T17:21:16.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5580e8c640 1 -- 172.21.15.167:0/1367664388 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c0acb20 con 0x7f557c06a0a0 2024-09-13T17:21:16.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef96d9d640 1 --2- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900202c0 0x7fef9001c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9659c640 1 -- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900202c0 msgr2=0x7fef9001c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 -- 172.21.15.167:0/1064045345 shutdown_connections 2024-09-13T17:21:16.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 --2- 172.21.15.167:0/1064045345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c8142370 0x7fd5c8142800 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 --2- 172.21.15.167:0/1064045345 >> v2:172.21.15.190:3300/0 conn(0x7fd5c806b380 0x7fd5c8141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 -- 172.21.15.167:0/1064045345 >> 172.21.15.167:0/1064045345 conn(0x7fd5c806a660 msgr2=0x7fd5c80b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 -- 172.21.15.167:0/1064045345 shutdown_connections 2024-09-13T17:21:16.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f6484e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f600ac3e0 con 0x7f9f60144fe0 2024-09-13T17:21:16.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5ed9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9f600adc70 0x7f9f60099670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f779141a640 1 --2- 172.21.15.167:0/4175687082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 0x7f77840386f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77780097c0 tx=0x7f777802d370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6a8ceadcecc192 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5ed9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9f600adc70 0x7f9f60099670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41068/0 (socket says 172.21.15.167:41068) 2024-09-13T17:21:16.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5ed9d640 1 -- 172.21.15.167:0/425910783 learned_addr learned my addr 172.21.15.167:0/425910783 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9c96c640 1 -- 172.21.15.167:0/2510416045 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98122700 con 0x7f3d900084b0 2024-09-13T17:21:16.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9c96c640 1 -- 172.21.15.167:0/2510416045 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d98122860 con 0x7f3d900084b0 2024-09-13T17:21:16.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9c96c640 1 -- 172.21.15.167:0/2510416045 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98122c90 con 0x7f3d900084b0 2024-09-13T17:21:16.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f6484e640 1 -- 172.21.15.167:0/425910783 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600ad2a0 con 0x7f9f60142080 2024-09-13T17:21:16.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f6484e640 1 -- 172.21.15.167:0/425910783 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600b2cd0 con 0x7f9f600adc70 2024-09-13T17:21:16.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 -- 172.21.15.167:0/1367664388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a0a0 msgr2=0x7f557c148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 --2- 172.21.15.167:0/1367664388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a0a0 0x7f557c148e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f557c0677a0 tx=0x7f556c01c540 comp rx=0 tx=0).stop 2024-09-13T17:21:16.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f778b7fe640 1 -- 172.21.15.167:0/4175687082 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77780bc400 con 0x7f7784020410 2024-09-13T17:21:16.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 -- 172.21.15.167:0/933192207 shutdown_connections 2024-09-13T17:21:16.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f2feccb1640 1 -- 172.21.15.167:0/933192207 wait complete. 2024-09-13T17:21:16.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5e59c640 1 --2- 172.21.15.167:0/425910783 >> v2:172.21.15.167:3300/0 conn(0x7f9f60142080 0x7f9f601424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f778b7fe640 1 -- 172.21.15.167:0/4175687082 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77780b8050 con 0x7f7784020410 2024-09-13T17:21:16.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 -- 172.21.15.167:0/1367664388 shutdown_connections 2024-09-13T17:21:16.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 --2- 172.21.15.167:0/1367664388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a4f0 0x7f557c149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 --2- 172.21.15.167:0/1367664388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a0a0 0x7f557c148e40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 --2- 172.21.15.167:0/1367664388 >> v2:172.21.15.190:3300/0 conn(0x7f557c099f20 0x7f557c06ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 -- 172.21.15.167:0/1367664388 >> 172.21.15.167:0/1367664388 conn(0x7f557c0b7cf0 msgr2=0x7f557c0b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5dd9b640 1 -- 172.21.15.167:0/425910783 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074132718 0 0) 0x7f9f600ac3e0 con 0x7f9f60144fe0 2024-09-13T17:21:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5dd9b640 1 -- 172.21.15.167:0/425910783 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f48003530 con 0x7f9f60144fe0 2024-09-13T17:21:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 -- 172.21.15.167:0/2510416045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900084b0 msgr2=0x7f3d90007710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 --2- 172.21.15.167:0/2510416045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900084b0 0x7f3d90007710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d98074040 tx=0x7f3d98096720 comp rx=0 tx=0).stop 2024-09-13T17:21:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5e59c640 1 -- 172.21.15.167:0/425910783 >> v2:172.21.15.190:3300/0 conn(0x7f9f600adc70 msgr2=0x7f9f60099670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5e59c640 1 --2- 172.21.15.167:0/425910783 >> v2:172.21.15.190:3300/0 conn(0x7f9f600adc70 0x7f9f60099670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5e59c640 1 -- 172.21.15.167:0/425910783 >> v1:172.21.15.190:6789/0 conn(0x7f9f60144fe0 legacy=0x7f9f601453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 -- 172.21.15.167:0/1367664388 shutdown_connections 2024-09-13T17:21:16.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f9f5e59c640 1 -- 172.21.15.167:0/425910783 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600ae050 con 0x7f9f60142080 2024-09-13T17:21:16.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 -- 172.21.15.167:0/2510416045 shutdown_connections 2024-09-13T17:21:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 --2- 172.21.15.167:0/2510416045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900c8ea0 0x7f3d900c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 --2- 172.21.15.167:0/2510416045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900084b0 0x7f3d90007710 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d98074040 tx=0x7f3d98096720 comp rx=0 tx=0).stop 2024-09-13T17:21:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 -- 172.21.15.167:0/2510416045 >> 172.21.15.167:0/2510416045 conn(0x7f3d9000b080 msgr2=0x7f3d9000b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 -- 172.21.15.167:0/2510416045 shutdown_connections 2024-09-13T17:21:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 -- 172.21.15.167:0/1064045345 wait complete. 2024-09-13T17:21:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f7792e7d640 1 -- 172.21.15.167:0/4175687082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 msgr2=0x7f77840386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f7792e7d640 1 --2- 172.21.15.167:0/4175687082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 0x7f77840386f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77780097c0 tx=0x7f777802d370 comp rx=0 tx=0).stop 2024-09-13T17:21:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 Processor -- start 2024-09-13T17:21:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f7792e7d640 1 -- 172.21.15.167:0/4175687082 shutdown_connections 2024-09-13T17:21:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f7792e7d640 1 --2- 172.21.15.167:0/4175687082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 0x7f77840386f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f7792e7d640 1 --2- 172.21.15.167:0/4175687082 >> v2:172.21.15.190:3300/0 conn(0x7f778401cef0 0x7f7784006040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f7792e7d640 1 -- 172.21.15.167:0/4175687082 >> 172.21.15.167:0/4175687082 conn(0x7f7784009730 msgr2=0x7f7784009b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 Processor -- start 2024-09-13T17:21:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 -- start start 2024-09-13T17:21:16.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f5582e90640 1 -- 172.21.15.167:0/1367664388 wait complete. 2024-09-13T17:21:16.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 Processor -- start 2024-09-13T17:21:16.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9659c640 1 --2- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900202c0 0x7fef9001c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9659c640 1 -- 172.21.15.167:0/1064826732 >> v1:172.21.15.190:6789/0 conn(0x7fef9001bbf0 legacy=0x7fef9001fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef9659c640 1 -- 172.21.15.167:0/1064826732 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9003bd90 con 0x7fef9003b9b0 2024-09-13T17:21:16.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fef96d9d640 1 --2- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900202c0 0x7fef9001c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:16.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7fd5d03aa640 1 -- start start 2024-09-13T17:21:16.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c806ab10 0x7fd5c814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5c806b380 0x7fd5c81df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c8142370 0x7fd5c81dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81e30d0 con 0x7fd5c8142370 2024-09-13T17:21:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81e33b0 con 0x7fd5c806b380 2024-09-13T17:21:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.186+0000 7f3d9e970640 1 -- 172.21.15.167:0/2510416045 wait complete. 2024-09-13T17:21:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 Processor -- start 2024-09-13T17:21:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81e3690 con 0x7fd5c806ab10 2024-09-13T17:21:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe81473d0 0x7f2fe81e5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fe814d990 0x7f2fe8120010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe8120550 0x7f2fe8121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe806f890 con 0x7f2fe81473d0 2024-09-13T17:21:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81e6440 con 0x7f2fe8120550 2024-09-13T17:21:16.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2feccb1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81e5e80 con 0x7f2fe814d990 2024-09-13T17:21:16.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5c806b380 0x7fd5c81df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5c806b380 0x7fd5c81df5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41084/0 (socket says 172.21.15.167:41084) 2024-09-13T17:21:16.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 -- 172.21.15.167:0/488852424 learned_addr learned my addr 172.21.15.167:0/488852424 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5ce146640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c806ab10 0x7fd5c814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5ce947640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c8142370 0x7fd5c81dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 -- start start 2024-09-13T17:21:16.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 -- 172.21.15.167:0/4175687082 shutdown_connections 2024-09-13T17:21:16.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fef9659c640 1 --2- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9003b9b0 0x7fef9001c0b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef98074040 tx=0x7fef98098840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e062007102db46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe81473d0 0x7f2fe81e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe81473d0 0x7f2fe81e5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42394/0 (socket says 172.21.15.167:42394) 2024-09-13T17:21:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 -- 172.21.15.167:0/1993875428 learned_addr learned my addr 172.21.15.167:0/1993875428 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 -- start start 2024-09-13T17:21:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a0a0 0x7f557c1ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a4f0 0x7f557c0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f557c099f20 0x7f557c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b0250 con 0x7f557c06a4f0 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b24f0 con 0x7f557c099f20 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b04f0 con 0x7f557c06a0a0 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5581e8e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a0a0 0x7f557c1ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a4f0 0x7f557c0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a4f0 0x7f557c0b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42378/0 (socket says 172.21.15.167:42378) 2024-09-13T17:21:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 -- 172.21.15.167:0/2133223743 learned_addr learned my addr 172.21.15.167:0/2133223743 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558268f640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f557c099f20 0x7f557c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe6d9d640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe8120550 0x7f2fe8121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe5d9b640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fe814d990 0x7f2fe8120010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 -- 172.21.15.167:0/1993875428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fe814d990 msgr2=0x7f2fe8120010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fe814d990 0x7f2fe8120010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 -- 172.21.15.167:0/1993875428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe8120550 msgr2=0x7f2fe8121c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe8120550 0x7f2fe8121c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 -- 172.21.15.167:0/1993875428 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80094d0 con 0x7f2fe81473d0 2024-09-13T17:21:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe6d9d640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe8120550 0x7f2fe8121c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d9000be00 0x7f3d900c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900c8ea0 0x7f3d90038130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900374e0 0x7f3d90038670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900c8ea0 0x7f3d90038130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900c8ea0 0x7f3d90038130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42396/0 (socket says 172.21.15.167:42396) 2024-09-13T17:21:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 -- 172.21.15.167:0/31343367 learned_addr learned my addr 172.21.15.167:0/31343367 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90039910 con 0x7f3d900c8ea0 2024-09-13T17:21:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90025640 con 0x7f3d9000be00 2024-09-13T17:21:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90025140 con 0x7f3d900374e0 2024-09-13T17:21:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 -- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a0a0 msgr2=0x7f557c1ee000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557c06a0a0 0x7f557c1ee000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 -- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f557c099f20 msgr2=0x7f557c0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f557c099f20 0x7f557c0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 -- 172.21.15.167:0/2133223743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0094d0 con 0x7f557c06a4f0 2024-09-13T17:21:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fef9559a640 1 -- 172.21.15.167:0/1064826732 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98122700 con 0x7fef9003b9b0 2024-09-13T17:21:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fef9559a640 1 -- 172.21.15.167:0/1064826732 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98122860 con 0x7fef9003b9b0 2024-09-13T17:21:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fef9559a640 1 -- 172.21.15.167:0/1064826732 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98122c90 con 0x7fef9003b9b0 2024-09-13T17:21:16.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f2fe659c640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe81473d0 0x7f2fe81e5580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2fd801a100 tx=0x7f2fd8019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 -- 172.21.15.167:0/4175687082 wait complete. 2024-09-13T17:21:16.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 Processor -- start 2024-09-13T17:21:16.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 -- 172.21.15.167:0/488852424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c806ab10 msgr2=0x7fd5c814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5c806ab10 0x7fd5c814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 -- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c8142370 msgr2=0x7fd5c81dfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c8142370 0x7fd5c81dfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 -- 172.21.15.167:0/488852424 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80094d0 con 0x7fd5c806b380 2024-09-13T17:21:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5cd945640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5c806b380 0x7fd5c81df5c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000efc0 tx=0x7fd5c000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f558168d640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a4f0 0x7f557c0b1de0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f556c01c370 tx=0x7f556c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fef9759e640 1 -- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9003b9b0 msgr2=0x7fef9001c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fef9759e640 1 --2- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9003b9b0 0x7fef9001c0b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef98074040 tx=0x7fef98098840 comp rx=0 tx=0).stop 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fef9759e640 1 -- 172.21.15.167:0/1064826732 shutdown_connections 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fef9759e640 1 --2- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900202c0 0x7fef9001c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fef9759e640 1 --2- 172.21.15.167:0/1064826732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9003b9b0 0x7fef9001c0b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fef9759e640 1 -- 172.21.15.167:0/1064826732 >> 172.21.15.167:0/1064826732 conn(0x7fef9003ebc0 msgr2=0x7fef9003b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5beffd640 1 -- 172.21.15.167:0/488852424 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0014480 con 0x7fd5c806b380 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5beffd640 1 -- 172.21.15.167:0/488852424 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000f040 con 0x7fd5c806b380 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5beffd640 1 -- 172.21.15.167:0/488852424 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00147e0 con 0x7fd5c806b380 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c806f030 con 0x7fd5c806b380 2024-09-13T17:21:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c8141e70 con 0x7fd5c806b380 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 -- 172.21.15.167:0/31343367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900374e0 msgr2=0x7f3d90038670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d900374e0 0x7f3d90038670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 -- 172.21.15.167:0/31343367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d9000be00 msgr2=0x7f3d900c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d9000be00 0x7f3d900c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900379c0 con 0x7f3d900c8ea0 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9d16d640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900c8ea0 0x7f3d90038130 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d9804fbc0 tx=0x7f3d90007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9812f070 con 0x7f3d900c8ea0 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9812a4f0 con 0x7f3d900c8ea0 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9812a860 con 0x7f3d900c8ea0 2024-09-13T17:21:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d90023c10 con 0x7f3d900c8ea0 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d900369c0 con 0x7f3d900c8ea0 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c0b6600 con 0x7f557c06a4f0 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c0b6760 con 0x7f557c06a4f0 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c0b6af0 con 0x7f557c06a4f0 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c0b07d0 con 0x7f557c06a4f0 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c1eeae0 con 0x7f557c06a4f0 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 -- start start 2024-09-13T17:21:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f778401cef0 0x7f77840cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 0x7f7784161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77840c9490 0x7f7784163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7784032290 con 0x7f778401cef0 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7784160da0 con 0x7f77840c9490 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.190+0000 7f7792e7d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7784032490 con 0x7f7784020410 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f778401cef0 0x7f77840cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f778401cef0 0x7f77840cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42410/0 (socket says 172.21.15.167:42410) 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 -- 172.21.15.167:0/527103014 learned_addr learned my addr 172.21.15.167:0/527103014 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 -- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 msgr2=0x7f7784161230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7784020410 0x7f7784161230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 -- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77840c9490 msgr2=0x7f7784163f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77840c9490 0x7f7784163f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 -- 172.21.15.167:0/527103014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778009420 con 0x7f778401cef0 2024-09-13T17:21:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80ad680 con 0x7f2fe81473d0 2024-09-13T17:21:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80ade90 con 0x7f2fe81473d0 2024-09-13T17:21:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80b8870 con 0x7f2fe81473d0 2024-09-13T17:21:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5564000fd0 con 0x7f557c06a4f0 2024-09-13T17:21:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe81e6160 con 0x7f2fe81473d0 2024-09-13T17:21:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe806e410 con 0x7f2fe81473d0 2024-09-13T17:21:16.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f7790c19640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f778401cef0 0x7f77840cc080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f778000e8c0 tx=0x7f778000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fe81460c0 con 0x7f2fe81473d0 2024-09-13T17:21:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fd5beffd640 1 -- 172.21.15.167:0/488852424 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5c0014940 con 0x7fd5c806b380 2024-09-13T17:21:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fd5beffd640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5ac0666c0 0x7fd5ac068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fd5ce146640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5ac0666c0 0x7fd5ac068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fd5beffd640 1 -- 172.21.15.167:0/488852424 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5c0084f90 con 0x7fd5c806b380 2024-09-13T17:21:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fef9759e640 1 -- 172.21.15.167:0/1064826732 shutdown_connections 2024-09-13T17:21:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fef9759e640 1 -- 172.21.15.167:0/1064826732 wait complete. 2024-09-13T17:21:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7fd5ce146640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5ac0666c0 0x7fd5ac068b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4001ec0 tx=0x7fd5c4009ae0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d9003d620 con 0x7f3d900c8ea0 2024-09-13T17:21:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f9f5e59c640 1 --2- 172.21.15.167:0/425910783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f60142080 0x7f9f601424f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f6009cc40 tx=0x7f9f5001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896616ae7520326c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f9f5dd9b640 1 -- 172.21.15.167:0/425910783 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500ab600 con 0x7f9f60142080 2024-09-13T17:21:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f9f5dd9b640 1 -- 172.21.15.167:0/425910783 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f500a7050 con 0x7f9f60142080 2024-09-13T17:21:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f9f5dd9b640 1 -- 172.21.15.167:0/425910783 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500ab980 con 0x7f9f60142080 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f556c0b6c50 con 0x7f557c06a4f0 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f55727fc640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5560066690 0x7f5560068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f556c11f100 con 0x7f557c06a4f0 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.194+0000 7f5581e8e640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5560066690 0x7f5560068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f55727fc640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f556006fc50 0x7f5560072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 --> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5560072760 con 0x7f556006fc50 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f556c11f470 con 0x7f557c06a4f0 2024-09-13T17:21:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f5581e8e640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5560066690 0x7f5560068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5578009980 tx=0x7f55780090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 Processor -- start 2024-09-13T17:21:16.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f558268f640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f556006fc50 0x7f5560072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fd5d03aa640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7fd5c813a290 0x7fd5c813a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 --> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5c80b2890 con 0x7fd5c813a290 2024-09-13T17:21:16.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000c940 con 0x7f778401cef0 2024-09-13T17:21:16.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f9f6484e640 1 -- 172.21.15.167:0/425910783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f60142080 msgr2=0x7f9f601424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f9f6484e640 1 --2- 172.21.15.167:0/425910783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f60142080 0x7f9f601424f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f6009cc40 tx=0x7f9f5001c330 comp rx=0 tx=0).stop 2024-09-13T17:21:16.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f9f6484e640 1 -- 172.21.15.167:0/425910783 shutdown_connections 2024-09-13T17:21:16.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f9f6484e640 1 --2- 172.21.15.167:0/425910783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f60142080 0x7f9f601424f0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f6009cc40 tx=0x7f9f5001c330 comp rx=0 tx=0).stop 2024-09-13T17:21:16.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f9f6484e640 1 --2- 172.21.15.167:0/425910783 >> v2:172.21.15.190:3300/0 conn(0x7f9f600adc70 0x7f9f60099670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f9f6484e640 1 -- 172.21.15.167:0/425910783 >> 172.21.15.167:0/425910783 conn(0x7f9f600b3a20 msgr2=0x7f9f600b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778000caa0 con 0x7f778401cef0 2024-09-13T17:21:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000ce50 con 0x7f778401cef0 2024-09-13T17:21:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fd5ce947640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7fd5c813a290 0x7fd5c813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fd5ce947640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7fd5c813a290 0x7fd5c813a670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7784032770 con 0x7f778401cef0 2024-09-13T17:21:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77841609c0 con 0x7f778401cef0 2024-09-13T17:21:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d98133070 con 0x7f3d900c8ea0 2024-09-13T17:21:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d8e7fc640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3d7c066690 0x7f3d7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d981986c0 con 0x7f3d900c8ea0 2024-09-13T17:21:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d8e7fc640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f3d7c06fcd0 0x7f3d7c072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d7c0727e0 con 0x7f3d7c06fcd0 2024-09-13T17:21:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d98198a70 con 0x7f3d900c8ea0 2024-09-13T17:21:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f778401ec60 con 0x7f778401cef0 2024-09-13T17:21:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2fd80b4070 con 0x7f2fe81473d0 2024-09-13T17:21:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f2fd6ffd640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2fc80666e0 0x7f2fc8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fd811ecb0 con 0x7f2fe81473d0 2024-09-13T17:21:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f2fd6ffd640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7f2fc806fca0 0x7f2fc80720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 --> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fc80727b0 con 0x7f2fc806fca0 2024-09-13T17:21:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f2fe5d9b640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2fc80666e0 0x7f2fc8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fd5beffd640 1 -- 172.21.15.167:0/488852424 <== osd.2 v2:172.21.15.167:6816/3360843643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd5c80b2890 con 0x7fd5c813a290 2024-09-13T17:21:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d9e16f640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f3d7c06fcd0 0x7f3d7c072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d9d96e640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3d7c066690 0x7f3d7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 -- start start 2024-09-13T17:21:16.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f2fe6d9d640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7f2fc806fca0 0x7f2fc80720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef900202c0 0x7fef90035b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef9003b9b0 0x7fef900c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef900c6bd0 0x7fef90037d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900372d0 con 0x7fef900c6bd0 2024-09-13T17:21:16.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900377b0 con 0x7fef900202c0 2024-09-13T17:21:16.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7fef9759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef90033f50 con 0x7fef9003b9b0 2024-09-13T17:21:16.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d9d96e640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3d7c066690 0x7f3d7c068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d94000f70 tx=0x7f3d940079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.198+0000 7f3d9e16f640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f3d7c06fcd0 0x7f3d7c072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f558268f640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f556006fc50 0x7f5560072090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f2fe5d9b640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2fc80666e0 0x7f2fc8068ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8145cb0 tx=0x7f2fe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fd80ebe10 con 0x7f2fe81473d0 2024-09-13T17:21:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef9003b9b0 0x7fef900c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef9003b9b0 0x7fef900c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.167:38314/0 (socket says 172.21.15.167:38314) 2024-09-13T17:21:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 -- 172.21.15.167:0/3014065583 learned_addr learned my addr 172.21.15.167:0/3014065583 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef9659c640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef900202c0 0x7fef90035b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f9f6484e640 1 -- 172.21.15.167:0/425910783 shutdown_connections 2024-09-13T17:21:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f9f6484e640 1 -- 172.21.15.167:0/425910783 wait complete. 2024-09-13T17:21:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f2fe6d9d640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7f2fc806fca0 0x7f2fc80720e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== osd.3 v2:172.21.15.167:6817/2142249193 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3d7c0727e0 con 0x7f3d7c06fcd0 2024-09-13T17:21:16.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f9f6484e640 1 Processor -- start 2024-09-13T17:21:16.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== osd.6 v2:172.21.15.190:6808/2566293699 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5560072760 con 0x7f556006fc50 2024-09-13T17:21:16.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef96d9d640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef900c6bd0 0x7fef90037d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 -- 172.21.15.167:0/3014065583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef900202c0 msgr2=0x7fef90035b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef900202c0 0x7fef90035b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 -- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef900c6bd0 msgr2=0x7fef90037d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef900c6bd0 0x7fef90037d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef95d9b640 1 -- 172.21.15.167:0/3014065583 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90034230 con 0x7fef9003b9b0 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fef96d9d640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef900c6bd0 0x7fef90037d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7780013470 con 0x7f778401cef0 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f77897fa640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7770066690 0x7f7770068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7780084ab0 con 0x7f778401cef0 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f77897fa640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f777006fcd0 0x7f7770072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 --> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77700727e0 con 0x7f777006fcd0 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7780084e60 con 0x7f778401cef0 2024-09-13T17:21:16.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f779141a640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f777006fcd0 0x7f7770072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== osd.1 v2:172.21.15.167:6800/829452776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2fc80727b0 con 0x7f2fc806fca0 2024-09-13T17:21:16.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fd1c8c60640 1 Processor -- start 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7fd1c8c60640 1 -- start start 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c8c60640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1bc01e200 0x7fd1bc0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c8c60640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c37fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd1bc00be00 0x7fd1bc0cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.167:56746/0 (socket says 172.21.15.167:56746) 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c37fe640 1 -- 172.21.15.167:0/977379114 learned_addr learned my addr 172.21.15.167:0/977379114 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f6484e640 1 -- start start 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f6484e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f600adc70 0x7f9f6006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f6484e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f60144fe0 0x7f9f6013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f6484e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f600707e0 0x7f9f6013e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f6484e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f601e2b40 con 0x7f9f600707e0 2024-09-13T17:21:16.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f6484e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6014a110 con 0x7f9f60144fe0 2024-09-13T17:21:16.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f6484e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6006e390 con 0x7f9f600adc70 2024-09-13T17:21:16.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc01f530 con 0x7fd1bc00be00 2024-09-13T17:21:16.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c3fff640 1 --2- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c2ffd640 1 --2- 172.21.15.167:0/977379114 >> v2:172.21.15.190:3300/0 conn(0x7fd1bc01e200 0x7fd1bc0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc021830 con 0x7fd1bc01e200 2024-09-13T17:21:16.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc03afa0 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f600adc70 0x7f9f6006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f600707e0 0x7f9f6013e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f600707e0 0x7f9f6013e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42424/0 (socket says 172.21.15.167:42424) 2024-09-13T17:21:16.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c27fc640 1 -- 172.21.15.167:0/977379114 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063706084 0 0) 0x7fd1bc01f530 con 0x7fd1bc00be00 2024-09-13T17:21:16.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c27fc640 1 -- 172.21.15.167:0/977379114 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b4007940 con 0x7fd1bc00be00 2024-09-13T17:21:16.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 -- 172.21.15.167:0/1368005650 learned_addr learned my addr 172.21.15.167:0/1368005650 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fef95d9b640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef9003b9b0 0x7fef900c6690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef8800c450 tx=0x7fef8800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88012830 con 0x7fef9003b9b0 2024-09-13T17:21:16.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef880129b0 con 0x7fef9003b9b0 2024-09-13T17:21:16.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88012d60 con 0x7fef9003b9b0 2024-09-13T17:21:16.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c2ffd640 1 -- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc0cdf40 msgr2=0x7fd1bc0d4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c2ffd640 1 --2- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c2ffd640 1 -- 172.21.15.167:0/977379114 >> v1:172.21.15.190:6789/0 conn(0x7fd1bc00be00 legacy=0x7fd1bc0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7fd1c2ffd640 1 -- 172.21.15.167:0/977379114 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc01f2c0 con 0x7fd1bc01e200 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.202+0000 7f779141a640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f777006fcd0 0x7f7770072110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f778bfff640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7770066690 0x7f7770068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f778bfff640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7770066690 0x7f7770068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f778c04fb60 tx=0x7f778c068070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== osd.7 v2:172.21.15.190:6800/1492320865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f77700727e0 con 0x7f777006fcd0 2024-09-13T17:21:16.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fd1c2ffd640 1 --2- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 0x7fd1bc0cda00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80097f0 tx=0x7fd1b801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2963768fdc6ca361 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90034510 con 0x7fef9003b9b0 2024-09-13T17:21:16.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef900c8c20 con 0x7fef9003b9b0 2024-09-13T17:21:16.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef90005800 con 0x7fef9003b9b0 2024-09-13T17:21:16.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fd1c27fc640 1 -- 172.21.15.167:0/977379114 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80ab400 con 0x7fd1bc01e200 2024-09-13T17:21:16.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fd1c27fc640 1 -- 172.21.15.167:0/977379114 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80a7050 con 0x7fd1bc01e200 2024-09-13T17:21:16.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fd1c27fc640 1 -- 172.21.15.167:0/977379114 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80ab760 con 0x7fd1bc01e200 2024-09-13T17:21:16.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 msgr2=0x7fd1bc0cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.210+0000 7fd1c8c60640 1 --2- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 0x7fd1bc0cda00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80097f0 tx=0x7fd1b801c3a0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 -- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f600adc70 msgr2=0x7f9f6006f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f600adc70 0x7f9f6006f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 -- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f60144fe0 msgr2=0x7f9f6013e2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:21:16.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f60144fe0 0x7f9f6013e2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 -- 172.21.15.167:0/1368005650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50009420 con 0x7f9f600707e0 2024-09-13T17:21:16.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.206+0000 7f9f5f59e640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f600707e0 0x7f9f6013e830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400c6d0 tx=0x7f9f5400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 shutdown_connections 2024-09-13T17:21:16.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 --2- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 --2- 172.21.15.167:0/977379114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 0x7fd1bc0cda00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 >> 172.21.15.167:0/977379114 conn(0x7fd1bc00b080 msgr2=0x7fd1bc00b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 shutdown_connections 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef8801c460 con 0x7fef9003b9b0 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef86ffd640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef7806ab70 0x7fef7806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef88084cb0 con 0x7fef9003b9b0 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef9659c640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef7806ab70 0x7fef7806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef86ffd640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef780741b0 0x7fef780765f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 --> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef78076cc0 con 0x7fef780741b0 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef88085060 con 0x7fef9003b9b0 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef96d9d640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef780741b0 0x7fef780765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- 172.21.15.167:0/977379114 wait complete. 2024-09-13T17:21:16.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 Processor -- start 2024-09-13T17:21:16.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef96d9d640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef780741b0 0x7fef780765f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef9659c640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef7806ab70 0x7fef7806d030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fef9003f150 tx=0x7fef98123000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== osd.0 v2:172.21.15.167:6807/3243107293 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fef78076cc0 con 0x7fef780741b0 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 --> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd5c806b7b0 con 0x7fd5c813a290 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5beffd640 1 -- 172.21.15.167:0/488852424 <== osd.2 v2:172.21.15.167:6816/3360843643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd5b80ab500 con 0x7fd5c813a290 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7fd5c813a290 msgr2=0x7fd5c813a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7fd5c813a290 0x7fd5c813a670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5ac0666c0 msgr2=0x7fd5ac068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5ac0666c0 0x7fd5ac068b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4001ec0 tx=0x7fd5c4009ae0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5c806b380 msgr2=0x7fd5c81df5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 --2- 172.21.15.167:0/488852424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5c806b380 0x7fd5c81df5c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000efc0 tx=0x7fd5c000c490 comp rx=0 tx=0).stop 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5ce947640 1 -- 172.21.15.167:0/488852424 reap_dead start 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 shutdown_connections 2024-09-13T17:21:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 >> 172.21.15.167:0/488852424 conn(0x7fd5c806a660 msgr2=0x7fd5c80b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 shutdown_connections 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd5d03aa640 1 -- 172.21.15.167:0/488852424 wait complete. 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- start start 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc00be00 0x7fd1bc0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 0x7fd1bc173e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c92d0 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0cb830 con 0x7fd1bc01e200 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c8c60640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d4460 con 0x7fd1bc00be00 2024-09-13T17:21:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42434/0 (socket says 172.21.15.167:42434) 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c3fff640 1 -- 172.21.15.167:0/1160109789 learned_addr learned my addr 172.21.15.167:0/1160109789 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.214+0000 7fd1c2ffd640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 0x7fd1bc173e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd1c3fff640 1 -- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc00be00 msgr2=0x7fd1bc0c9dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd1c3fff640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1bc00be00 0x7fd1bc0c9dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd1c3fff640 1 -- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 msgr2=0x7fd1bc173e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd1c3fff640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 0x7fd1bc173e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd1c3fff640 1 -- 172.21.15.167:0/1160109789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8009420 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd1c2ffd640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1bc01e200 0x7fd1bc173e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.218+0000 7fd1c3fff640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d3680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000e7c0 tx=0x7fd1b000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1affff640 1 -- 172.21.15.167:0/1160109789 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000c730 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1affff640 1 -- 172.21.15.167:0/1160109789 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b000c890 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1affff640 1 -- 172.21.15.167:0/1160109789 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000cc00 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0c8c80 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc0cb550 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1affff640 1 -- 172.21.15.167:0/1160109789 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1b0013470 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 --> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5564002cc0 con 0x7f556006fc50 2024-09-13T17:21:16.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7f55727fc640 1 -- 172.21.15.167:0/2133223743 <== osd.6 v2:172.21.15.190:6808/2566293699 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5564002cc0 con 0x7f556006fc50 2024-09-13T17:21:16.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1affff640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd1a80666e0 0x7fd1a8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1affff640 1 -- 172.21.15.167:0/1160109789 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1b00842e0 con 0x7fd1bc0cdf40 2024-09-13T17:21:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1c37fe640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd1a80666e0 0x7fd1a8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540052d0 con 0x7f9f600707e0 2024-09-13T17:21:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54005430 con 0x7f9f600707e0 2024-09-13T17:21:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f60070d10 con 0x7f9f600707e0 2024-09-13T17:21:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6013fc20 con 0x7f9f600707e0 2024-09-13T17:21:16.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.222+0000 7fd1c37fe640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd1a80666e0 0x7fd1a8068ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4063c00 tx=0x7fd1c40684e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f556006fc50 msgr2=0x7f5560072090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f556006fc50 0x7f5560072090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400a880 con 0x7f9f600707e0 2024-09-13T17:21:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f40000fd0 con 0x7f9f600707e0 2024-09-13T17:21:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5560066690 msgr2=0x7f5560068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5560066690 0x7f5560068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5578009980 tx=0x7f55780090e0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a4f0 msgr2=0x7f557c0b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 --2- 172.21.15.167:0/2133223743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f557c06a4f0 0x7f557c0b1de0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f556c01c370 tx=0x7f556c0192e0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f558268f640 1 -- 172.21.15.167:0/2133223743 reap_dead start 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 shutdown_connections 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 >> 172.21.15.167:0/2133223743 conn(0x7f557c0b7cf0 msgr2=0x7f557c148e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 shutdown_connections 2024-09-13T17:21:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f5400acb0 con 0x7f9f600707e0 2024-09-13T17:21:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f5582e90640 1 -- 172.21.15.167:0/2133223743 wait complete. 2024-09-13T17:21:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7fd1c8c60640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7fd1a00015f0 0x7fd1a0003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f477fe640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f4c066760 0x7f9f4c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f54084e00 con 0x7f9f600707e0 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f5ed9d640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f4c066760 0x7f9f4c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f477fe640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f9f4c06fc30 0x7f9f4c072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 --> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f4c072740 con 0x7f9f4c06fc30 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f5ed9d640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f4c066760 0x7f9f4c068c20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9f6006edb0 tx=0x7f9f580091b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f540851b0 con 0x7f9f600707e0 2024-09-13T17:21:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.226+0000 7f9f5e59c640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f9f4c06fc30 0x7f9f4c072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 --> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d900d9310 con 0x7f3d7c06fcd0 2024-09-13T17:21:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 --> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1a0006b50 con 0x7fd1a00015f0 2024-09-13T17:21:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f9f5e59c640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f9f4c06fc30 0x7f9f4c072070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7fd1c2ffd640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7fd1a00015f0 0x7fd1a0003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d8e7fc640 1 -- 172.21.15.167:0/31343367 <== osd.3 v2:172.21.15.167:6817/2142249193 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d88004040 con 0x7f3d7c06fcd0 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f3d7c06fcd0 msgr2=0x7f3d7c072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e970640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f3d7c06fcd0 0x7f3d7c072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3d7c066690 msgr2=0x7f3d7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e970640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3d7c066690 0x7f3d7c068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d94000f70 tx=0x7f3d940079c0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900c8ea0 msgr2=0x7f3d90038130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e970640 1 --2- 172.21.15.167:0/31343367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d900c8ea0 0x7f3d90038130 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d9804fbc0 tx=0x7f3d90007e60 comp rx=0 tx=0).stop 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f3d9e16f640 1 -- 172.21.15.167:0/31343367 reap_dead start 2024-09-13T17:21:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.230+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== osd.5 v2:172.21.15.190:6824/362265715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9f4c072740 con 0x7f9f4c06fc30 2024-09-13T17:21:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 --> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7784160ee0 con 0x7f777006fcd0 2024-09-13T17:21:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 shutdown_connections 2024-09-13T17:21:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 >> 172.21.15.167:0/31343367 conn(0x7f3d9000b080 msgr2=0x7f3d9003e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 shutdown_connections 2024-09-13T17:21:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f3d9e970640 1 -- 172.21.15.167:0/31343367 wait complete. 2024-09-13T17:21:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7fd1c2ffd640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7fd1a00015f0 0x7fd1a0003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f77897fa640 1 -- 172.21.15.167:0/527103014 <== osd.7 v2:172.21.15.190:6800/1492320865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7778006e20 con 0x7f777006fcd0 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f777006fcd0 msgr2=0x7f7770072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f777006fcd0 0x7f7770072110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7770066690 msgr2=0x7f7770068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7770066690 0x7f7770068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f778c04fb60 tx=0x7f778c068070 comp rx=0 tx=0).stop 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f778401cef0 msgr2=0x7f77840cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 --2- 172.21.15.167:0/527103014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f778401cef0 0x7f77840cc080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f778000e8c0 tx=0x7f778000ed80 comp rx=0 tx=0).stop 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f779141a640 1 -- 172.21.15.167:0/527103014 reap_dead start 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 shutdown_connections 2024-09-13T17:21:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 >> 172.21.15.167:0/527103014 conn(0x7f7784009730 msgr2=0x7f77840c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 shutdown_connections 2024-09-13T17:21:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.234+0000 7f7792e7d640 1 -- 172.21.15.167:0/527103014 wait complete. 2024-09-13T17:21:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.238+0000 7fd1affff640 1 -- 172.21.15.167:0/1160109789 <== osd.4 v2:172.21.15.190:6811/2201043679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd1a0006b50 con 0x7fd1a00015f0 2024-09-13T17:21:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.238+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 --> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fe80ac560 con 0x7f2fc806fca0 2024-09-13T17:21:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2fd6ffd640 1 -- 172.21.15.167:0/1993875428 <== osd.1 v2:172.21.15.167:6800/829452776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fdc00b440 con 0x7f2fc806fca0 2024-09-13T17:21:16.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 --> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef900c6fb0 con 0x7fef780741b0 2024-09-13T17:21:16.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7fef86ffd640 1 -- 172.21.15.167:0/3014065583 <== osd.0 v2:172.21.15.167:6807/3243107293 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef900c6fb0 con 0x7fef780741b0 2024-09-13T17:21:16.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7f2fc806fca0 msgr2=0x7f2fc80720e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7f2fc806fca0 0x7f2fc80720e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2fc80666e0 msgr2=0x7f2fc8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2fc80666e0 0x7f2fc8068ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8145cb0 tx=0x7f2fe0009040 comp rx=0 tx=0).stop 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe81473d0 msgr2=0x7f2fe81e5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 --2- 172.21.15.167:0/1993875428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fe81473d0 0x7f2fe81e5580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2fd801a100 tx=0x7f2fd8019270 comp rx=0 tx=0).stop 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2fe6d9d640 1 -- 172.21.15.167:0/1993875428 reap_dead start 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 shutdown_connections 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 >> 172.21.15.167:0/1993875428 conn(0x7f2fe80b7420 msgr2=0x7f2fe8146250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 shutdown_connections 2024-09-13T17:21:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.242+0000 7f2feccb1640 1 -- 172.21.15.167:0/1993875428 wait complete. 2024-09-13T17:21:16.283 INFO:teuthology.orchestra.run.smithi167.stdout:55834574859 2024-09-13T17:21:16.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:21:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.246+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 --> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f40002cc0 con 0x7f9f4c06fc30 2024-09-13T17:21:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.246+0000 7f9f477fe640 1 -- 172.21.15.167:0/1368005650 <== osd.5 v2:172.21.15.190:6824/362265715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f40002cc0 con 0x7f9f4c06fc30 2024-09-13T17:21:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.246+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f9f4c06fc30 msgr2=0x7f9f4c072070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.246+0000 7f9f6484e640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f9f4c06fc30 0x7f9f4c072070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f4c066760 msgr2=0x7f9f4c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f4c066760 0x7f9f4c068c20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9f6006edb0 tx=0x7f9f580091b0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f600707e0 msgr2=0x7f9f6013e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 --2- 172.21.15.167:0/1368005650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f600707e0 0x7f9f6013e830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400c6d0 tx=0x7f9f5400cb90 comp rx=0 tx=0).stop 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f5f59e640 1 -- 172.21.15.167:0/1368005650 reap_dead start 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 shutdown_connections 2024-09-13T17:21:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 >> 172.21.15.167:0/1368005650 conn(0x7f9f600b3a20 msgr2=0x7f9f601453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 shutdown_connections 2024-09-13T17:21:16.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7f9f6484e640 1 -- 172.21.15.167:0/1368005650 wait complete. 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef780741b0 msgr2=0x7fef780765f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7fef9759e640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef780741b0 0x7fef780765f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef7806ab70 msgr2=0x7fef7806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7fef9759e640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef7806ab70 0x7fef7806d030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fef9003f150 tx=0x7fef98123000 comp rx=0 tx=0).stop 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef9003b9b0 msgr2=0x7fef900c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7fef9759e640 1 --2- 172.21.15.167:0/3014065583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef9003b9b0 0x7fef900c6690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef8800c450 tx=0x7fef8800c910 comp rx=0 tx=0).stop 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.250+0000 7fef96d9d640 1 -- 172.21.15.167:0/3014065583 reap_dead start 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.254+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 shutdown_connections 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.254+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 >> 172.21.15.167:0/3014065583 conn(0x7fef9003ebc0 msgr2=0x7fef90004f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.254+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 shutdown_connections 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.254+0000 7fef9759e640 1 -- 172.21.15.167:0/3014065583 wait complete. 2024-09-13T17:21:16.288 INFO:teuthology.orchestra.run.smithi167.stdout:64424509449 2024-09-13T17:21:16.288 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:21:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 --> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1a0005bd0 con 0x7fd1a00015f0 2024-09-13T17:21:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1affff640 1 -- 172.21.15.167:0/1160109789 <== osd.4 v2:172.21.15.190:6811/2201043679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1a0005bd0 con 0x7fd1a00015f0 2024-09-13T17:21:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7fd1a00015f0 msgr2=0x7fd1a0003ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7fd1a00015f0 0x7fd1a0003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd1a80666e0 msgr2=0x7fd1a8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd1a80666e0 0x7fd1a8068ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4063c00 tx=0x7fd1c40684e0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1bc0cdf40 msgr2=0x7fd1bc0d3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 --2- 172.21.15.167:0/1160109789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1bc0cdf40 0x7fd1bc0d3680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000e7c0 tx=0x7fd1b000ec80 comp rx=0 tx=0).stop 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c3fff640 1 -- 172.21.15.167:0/1160109789 reap_dead start 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 shutdown_connections 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 >> 172.21.15.167:0/1160109789 conn(0x7fd1bc00b080 msgr2=0x7fd1bc01fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 shutdown_connections 2024-09-13T17:21:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.262+0000 7fd1c8c60640 1 -- 172.21.15.167:0/1160109789 wait complete. 2024-09-13T17:21:16.292 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2024-09-13T17:21:16.292 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:21:16.293 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2024-09-13T17:21:16.293 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:21:16.297 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2024-09-13T17:21:16.298 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:21:16.298 INFO:teuthology.orchestra.run.smithi167.stdout:64424509449 2024-09-13T17:21:16.299 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:21:16.299 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2024-09-13T17:21:16.300 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:21:16.301 INFO:teuthology.orchestra.run.smithi167.stdout:64424509449 2024-09-13T17:21:16.301 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:21:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f91216fc640 1 Processor -- start 2024-09-13T17:21:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f91216fc640 1 -- start start 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f91216fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c06b410 0x7f911c0acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f91216fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f911c098a40 0x7f911c098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f91216fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c0ac730 con 0x7f911c099380 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f91216fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0ac1e0 con 0x7f911c098a40 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f91216fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c06b7f0 con 0x7f911c06b410 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911affd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c06b410 0x7f911c0acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911b7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f911c099380 0x7f911c141e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.167:56756/0 (socket says 172.21.15.167:56756) 2024-09-13T17:21:16.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911b7fe640 1 -- 172.21.15.167:0/3269556245 learned_addr learned my addr 172.21.15.167:0/3269556245 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911a7fc640 1 --2- 172.21.15.167:0/3269556245 >> v2:172.21.15.167:3300/0 conn(0x7f911c098a40 0x7f911c098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911affd640 1 -- 172.21.15.167:0/3269556245 >> v2:172.21.15.167:3300/0 conn(0x7f911c098a40 msgr2=0x7f911c098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911affd640 1 --2- 172.21.15.167:0/3269556245 >> v2:172.21.15.167:3300/0 conn(0x7f911c098a40 0x7f911c098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911affd640 1 -- 172.21.15.167:0/3269556245 >> v1:172.21.15.190:6789/0 conn(0x7f911c099380 legacy=0x7f911c141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f9119ffb640 1 -- 172.21.15.167:0/3269556245 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011237038 0 0) 0x7f911c0ac730 con 0x7f911c099380 2024-09-13T17:21:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.498+0000 7f911affd640 1 -- 172.21.15.167:0/3269556245 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c145550 con 0x7f911c06b410 2024-09-13T17:21:16.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f911affd640 1 --2- 172.21.15.167:0/3269556245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c06b410 0x7f911c0acea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f910c0097c0 tx=0x7f910c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db4fedd1cbd0a627 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f9119ffb640 1 -- 172.21.15.167:0/3269556245 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0ab600 con 0x7f911c06b410 2024-09-13T17:21:16.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f9119ffb640 1 -- 172.21.15.167:0/3269556245 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c0a7050 con 0x7f911c06b410 2024-09-13T17:21:16.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f9119ffb640 1 -- 172.21.15.167:0/3269556245 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0ab980 con 0x7f911c06b410 2024-09-13T17:21:16.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f7d2ce95640 1 Processor -- start 2024-09-13T17:21:16.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f7d2ce95640 1 -- start start 2024-09-13T17:21:16.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- 172.21.15.167:0/3269556245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c06b410 msgr2=0x7f911c0acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 --2- 172.21.15.167:0/3269556245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c06b410 0x7f911c0acea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f910c0097c0 tx=0x7f910c01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- 172.21.15.167:0/3269556245 shutdown_connections 2024-09-13T17:21:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 --2- 172.21.15.167:0/3269556245 >> v2:172.21.15.167:3300/0 conn(0x7f911c098a40 0x7f911c098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 --2- 172.21.15.167:0/3269556245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c06b410 0x7f911c0acea0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f910c0097c0 tx=0x7f910c01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- 172.21.15.167:0/3269556245 >> 172.21.15.167:0/3269556245 conn(0x7f911c06a660 msgr2=0x7f911c0b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ead2cc640 1 Processor -- start 2024-09-13T17:21:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ead2cc640 1 -- start start 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f7d2ce95640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d2806ab10 0x7f7d2806b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.502+0000 7f7d2ce95640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d280acea0 0x7f7d28098a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d2ce95640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d280b1bc0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d2ce95640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d280ac1e0 con 0x7f7d280acea0 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d2ce95640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28145810 con 0x7f7d2806ab10 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d25d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d280acea0 0x7f7d28098a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d25d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d280acea0 0x7f7d28098a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42448/0 (socket says 172.21.15.167:42448) 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d25d9b640 1 -- 172.21.15.167:0/3060857451 learned_addr learned my addr 172.21.15.167:0/3060857451 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- 172.21.15.167:0/3269556245 shutdown_connections 2024-09-13T17:21:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d2659c640 1 --2- 172.21.15.167:0/3060857451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d2806ab10 0x7f7d2806b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d2559a640 1 -- 172.21.15.167:0/3060857451 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900835906 0 0) 0x7f7d280b1bc0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d2559a640 1 -- 172.21.15.167:0/3060857451 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d10003530 con 0x7f7d280ad2d0 2024-09-13T17:21:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d25d9b640 1 -- 172.21.15.167:0/3060857451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d2806ab10 msgr2=0x7f7d2806b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d25d9b640 1 --2- 172.21.15.167:0/3060857451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d2806ab10 0x7f7d2806b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d25d9b640 1 -- 172.21.15.167:0/3060857451 >> v1:172.21.15.167:6789/0 conn(0x7f7d280ad2d0 legacy=0x7f7d28098f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f7d25d9b640 1 -- 172.21.15.167:0/3060857451 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28145520 con 0x7f7d280acea0 2024-09-13T17:21:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- 172.21.15.167:0/3269556245 wait complete. 2024-09-13T17:21:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ead2cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8145e80 0x7f4ea8142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ead2cc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4ea8148ce0 0x7f4ea8142d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ead2cc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea80ac9b0 con 0x7f4ea806b640 2024-09-13T17:21:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ead2cc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea8143290 con 0x7f4ea8148ce0 2024-09-13T17:21:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ead2cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea806ba20 con 0x7f4ea8145e80 2024-09-13T17:21:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ea77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4ea8148ce0 0x7f4ea8142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ea77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4ea8148ce0 0x7f4ea8142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41158/0 (socket says 172.21.15.167:41158) 2024-09-13T17:21:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ea77fe640 1 -- 172.21.15.167:0/3779800365 learned_addr learned my addr 172.21.15.167:0/3779800365 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 Processor -- start 2024-09-13T17:21:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ea77fe640 1 -- 172.21.15.167:0/3779800365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8145e80 msgr2=0x7f4ea8142810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:21:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ea77fe640 1 --2- 172.21.15.167:0/3779800365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8145e80 0x7f4ea8142810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ea77fe640 1 -- 172.21.15.167:0/3779800365 >> v1:172.21.15.190:6789/0 conn(0x7f4ea806b640 legacy=0x7f4ea8145770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:21:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f4ea77fe640 1 -- 172.21.15.167:0/3779800365 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea8149200 con 0x7f4ea8148ce0 2024-09-13T17:21:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- start start 2024-09-13T17:21:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f05bdd56640 1 Processor -- start 2024-09-13T17:21:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f911c098a40 0x7f911c070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c099380 0x7f911c147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f911c147130 0x7f911c141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1483a0 con 0x7f911c147130 2024-09-13T17:21:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c146ca0 con 0x7f911c098a40 2024-09-13T17:21:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f91216fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0714d0 con 0x7f911c099380 2024-09-13T17:21:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f911c147130 0x7f911c141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f6e6aa00640 1 Processor -- start 2024-09-13T17:21:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f911c147130 0x7f911c141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42452/0 (socket says 172.21.15.167:42452) 2024-09-13T17:21:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 -- 172.21.15.167:0/1345075212 learned_addr learned my addr 172.21.15.167:0/1345075212 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f6e6aa00640 1 -- start start 2024-09-13T17:21:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f05bdd56640 1 -- start start 2024-09-13T17:21:16.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911affd640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f911c098a40 0x7f911c070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7fe7ab222640 1 Processor -- start 2024-09-13T17:21:16.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7fe7ab222640 1 -- start start 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 -- 172.21.15.167:0/1345075212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c099380 msgr2=0x7f911c147e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c099380 0x7f911c147e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 -- 172.21.15.167:0/1345075212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f911c098a40 msgr2=0x7f911c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f911c098a40 0x7f911c070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.506+0000 7f911b7fe640 1 -- 172.21.15.167:0/1345075212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c009420 con 0x7f911c147130 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e6aa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6e5c031820 0x7f6e5c038fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e6aa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c03abb0 con 0x7f6e5c0ca340 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e6aa00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c039c40 con 0x7f6e5c03a740 2024-09-13T17:21:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e6aa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c01d670 con 0x7f6e5c031820 2024-09-13T17:21:16.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f911b7fe640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f911c147130 0x7f911c141300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f911000c470 tx=0x7f911000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bdd56640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05b813d9f0 0x7f05b80b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bdd56640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f05b80b44f0 0x7f05b8143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bdd56640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b80b6770 0x7f05b8144090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bdd56640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b806d0a0 con 0x7f05b80b44f0 2024-09-13T17:21:16.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bdd56640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80b4980 con 0x7f05b813d9f0 2024-09-13T17:21:16.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bdd56640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8143630 con 0x7f05b80b6770 2024-09-13T17:21:16.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e68f9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6e5c0ca340 0x7f6e5c0dacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47026/0 (socket says 172.21.15.167:47026) 2024-09-13T17:21:16.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e68f9d640 1 -- 172.21.15.167:0/1397409092 learned_addr learned my addr 172.21.15.167:0/1397409092 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:16.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f91037fe640 1 -- 172.21.15.167:0/1345075212 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100074e0 con 0x7f911c147130 2024-09-13T17:21:16.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f91037fe640 1 -- 172.21.15.167:0/1345075212 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9110007640 con 0x7f911c147130 2024-09-13T17:21:16.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f91216fc640 1 -- 172.21.15.167:0/1345075212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c1485e0 con 0x7f911c147130 2024-09-13T17:21:16.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05b813d9f0 0x7f05b80b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7ab222640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe79c0076b0 0x7fe79c0386d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05b813d9f0 0x7f05b80b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41186/0 (socket says 172.21.15.167:41186) 2024-09-13T17:21:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 -- 172.21.15.167:0/1202326329 learned_addr learned my addr 172.21.15.167:0/1202326329 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7ab222640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c01ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7ab222640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c038c10 con 0x7fe79c007a90 2024-09-13T17:21:16.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7ab222640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0cbf10 con 0x7fe79c0076b0 2024-09-13T17:21:16.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7ab222640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c034c00 con 0x7fe79c0ccbe0 2024-09-13T17:21:16.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e63fff640 1 --2- 172.21.15.167:0/1397409092 >> v2:172.21.15.167:3300/0 conn(0x7f6e5c031820 0x7f6e5c038fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f91037fe640 1 -- 172.21.15.167:0/1345075212 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110004a30 con 0x7f911c147130 2024-09-13T17:21:16.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f91216fc640 1 -- 172.21.15.167:0/1345075212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c14bcc0 con 0x7f911c147130 2024-09-13T17:21:16.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7aa220640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe79c0076b0 0x7fe79c0386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f7d25d9b640 1 --2- 172.21.15.167:0/3060857451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d280acea0 0x7f7d28098a40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009870 tx=0x7f7d1c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c89e54db0344602 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7aaa21640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c01ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7a9a1f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe79c007a90 0x7fe79c039d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47028/0 (socket says 172.21.15.167:47028) 2024-09-13T17:21:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7a9a1f640 1 -- 172.21.15.167:0/733789489 learned_addr learned my addr 172.21.15.167:0/733789489 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bd555640 1 --2- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b80b6770 0x7f05b8144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e62ffd640 1 -- 172.21.15.167:0/1397409092 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938820846 0 0) 0x7f6e5c03abb0 con 0x7f6e5c0ca340 2024-09-13T17:21:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e62ffd640 1 -- 172.21.15.167:0/1397409092 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e54003530 con 0x7f6e5c0ca340 2024-09-13T17:21:16.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f4ea77fe640 1 --2- 172.21.15.167:0/3779800365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea8148ce0 0x7f4ea8142d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e80 tx=0x7f4ea001c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96449ee58d27c485 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7aa220640 1 -- 172.21.15.167:0/733789489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 msgr2=0x7fe79c01ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7aa220640 1 --2- 172.21.15.167:0/733789489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c01ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7aa220640 1 -- 172.21.15.167:0/733789489 >> v1:172.21.15.167:6789/0 conn(0x7fe79c007a90 legacy=0x7fe79c039d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7aa220640 1 -- 172.21.15.167:0/733789489 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c03a490 con 0x7fe79c0076b0 2024-09-13T17:21:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f91216fc640 1 -- 172.21.15.167:0/1345075212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c0b1580 con 0x7f911c147130 2024-09-13T17:21:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f7d2559a640 1 -- 172.21.15.167:0/3060857451 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0ab670 con 0x7f7d280acea0 2024-09-13T17:21:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f4ea67fc640 1 -- 172.21.15.167:0/3779800365 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a57b0 con 0x7f4ea8148ce0 2024-09-13T17:21:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f4ea67fc640 1 -- 172.21.15.167:0/3779800365 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00a5910 con 0x7f4ea8148ce0 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f4ea67fc640 1 -- 172.21.15.167:0/3779800365 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a5ca0 con 0x7f4ea8148ce0 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 -- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b80b6770 msgr2=0x7f05b8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 --2- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b80b6770 0x7f05b8144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 -- 172.21.15.167:0/1202326329 >> v2:172.21.15.167:3300/0 conn(0x7f05b80b44f0 msgr2=0x7f05b8143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 --2- 172.21.15.167:0/1202326329 >> v2:172.21.15.167:3300/0 conn(0x7f05b80b44f0 0x7f05b8143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f05bcd54640 1 -- 172.21.15.167:0/1202326329 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80b4c60 con 0x7f05b813d9f0 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e63fff640 1 -- 172.21.15.167:0/1397409092 >> v1:172.21.15.190:6789/0 conn(0x7f6e5c03a740 legacy=0x7f6e5c01cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e63fff640 1 -- 172.21.15.167:0/1397409092 >> v1:172.21.15.167:6789/0 conn(0x7f6e5c0ca340 legacy=0x7f6e5c0dacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f6e63fff640 1 -- 172.21.15.167:0/1397409092 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c031c00 con 0x7f6e5c031820 2024-09-13T17:21:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7fe7aa220640 1 --2- 172.21.15.167:0/733789489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c0076b0 0x7fe79c0386d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7940097c0 tx=0x7fe79401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bf4b0064ace93b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7a921e640 1 -- 172.21.15.167:0/733789489 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7940ab600 con 0x7fe79c0076b0 2024-09-13T17:21:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7a921e640 1 -- 172.21.15.167:0/733789489 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7940a7050 con 0x7fe79c0076b0 2024-09-13T17:21:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7a921e640 1 -- 172.21.15.167:0/733789489 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7940ab980 con 0x7fe79c0076b0 2024-09-13T17:21:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- 172.21.15.167:0/3779800365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea8148ce0 msgr2=0x7f4ea8142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/3779800365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea8148ce0 0x7f4ea8142d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e80 tx=0x7f4ea001c930 comp rx=0 tx=0).stop 2024-09-13T17:21:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- 172.21.15.167:0/3779800365 shutdown_connections 2024-09-13T17:21:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/3779800365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea8148ce0 0x7f4ea8142d50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/3779800365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8145e80 0x7f4ea8142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- 172.21.15.167:0/3779800365 >> 172.21.15.167:0/3779800365 conn(0x7f4ea80b7420 msgr2=0x7f4ea80b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f6e63fff640 1 --2- 172.21.15.167:0/1397409092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c038fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e5801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ebad2203b9d29c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- 172.21.15.167:0/3779800365 shutdown_connections 2024-09-13T17:21:16.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bcd54640 1 --2- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 0x7f05b80b4f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05b806e740 tx=0x7f05ac01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ecb5453f31706f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05b77fe640 1 -- 172.21.15.167:0/1202326329 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0ab600 con 0x7f05b813d9f0 2024-09-13T17:21:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05b77fe640 1 -- 172.21.15.167:0/1202326329 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac0a7050 con 0x7f05b813d9f0 2024-09-13T17:21:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05b77fe640 1 -- 172.21.15.167:0/1202326329 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0ab960 con 0x7f05b813d9f0 2024-09-13T17:21:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f7d2559a640 1 -- 172.21.15.167:0/3060857451 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c0ab7d0 con 0x7f7d280acea0 2024-09-13T17:21:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.510+0000 7f7d2559a640 1 -- 172.21.15.167:0/3060857451 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0abb40 con 0x7f7d280acea0 2024-09-13T17:21:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f7d2ce95640 1 -- 172.21.15.167:0/3060857451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d280acea0 msgr2=0x7f7d28098a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/3060857451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d280acea0 0x7f7d28098a40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009870 tx=0x7f7d1c01c490 comp rx=0 tx=0).stop 2024-09-13T17:21:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f91037fe640 1 -- 172.21.15.167:0/1345075212 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9110004b90 con 0x7f911c147130 2024-09-13T17:21:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f91037fe640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f91080666c0 0x7f9108068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f91037fe640 1 -- 172.21.15.167:0/1345075212 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91100838c0 con 0x7f911c147130 2024-09-13T17:21:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f911affd640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f91080666c0 0x7f9108068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- 172.21.15.167:0/733789489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c0076b0 msgr2=0x7fe79c0386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 --2- 172.21.15.167:0/733789489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c0076b0 0x7fe79c0386d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7940097c0 tx=0x7fe79401c3a0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- 172.21.15.167:0/733789489 shutdown_connections 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 --2- 172.21.15.167:0/733789489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c01ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 --2- 172.21.15.167:0/733789489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c0076b0 0x7fe79c0386d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- 172.21.15.167:0/733789489 >> 172.21.15.167:0/733789489 conn(0x7fe79c03a7d0 msgr2=0x7fe79c03abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- 172.21.15.167:0/733789489 shutdown_connections 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- 172.21.15.167:0/733789489 wait complete. 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f7d2ce95640 1 -- 172.21.15.167:0/3060857451 shutdown_connections 2024-09-13T17:21:16.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/3060857451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d280acea0 0x7f7d28098a40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/3060857451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d2806ab10 0x7f7d2806b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f7d2ce95640 1 -- 172.21.15.167:0/3060857451 >> 172.21.15.167:0/3060857451 conn(0x7f7d2806a660 msgr2=0x7f7d280b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f911affd640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f91080666c0 0x7f9108068b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ad000 tx=0x7f910c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 -- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 msgr2=0x7f05b80b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 --2- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 0x7f05b80b4f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05b806e740 tx=0x7f05ac01c4b0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 -- 172.21.15.167:0/1202326329 shutdown_connections 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 --2- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b80b6770 0x7f05b8144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 --2- 172.21.15.167:0/1202326329 >> v2:172.21.15.167:3300/0 conn(0x7f05b80b44f0 0x7f05b8143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 --2- 172.21.15.167:0/1202326329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 0x7f05b80b4f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 -- 172.21.15.167:0/1202326329 >> 172.21.15.167:0/1202326329 conn(0x7f05b80b5c50 msgr2=0x7f05b80b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 -- 172.21.15.167:0/1202326329 shutdown_connections 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- 172.21.15.167:0/3779800365 wait complete. 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 Processor -- start 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef01399640 1 Processor -- start 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef01399640 1 -- start start 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef01399640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feefc0b1920 0x7feefc146c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef01399640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0b3570 con 0x7feefc06b410 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef01399640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0aced0 con 0x7feefc0ada70 2024-09-13T17:21:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef01399640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0acc60 con 0x7feefc0b1920 2024-09-13T17:21:16.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef00b98640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7feefc0ada70 0x7feefc147140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.167:56778/0 (socket says 172.21.15.167:56778) 2024-09-13T17:21:16.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fef00b98640 1 -- 172.21.15.167:0/587793827 learned_addr learned my addr 172.21.15.167:0/587793827 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:16.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 Processor -- start 2024-09-13T17:21:16.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- start start 2024-09-13T17:21:16.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f7d2ce95640 1 -- 172.21.15.167:0/3060857451 shutdown_connections 2024-09-13T17:21:16.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 -- 172.21.15.167:0/1202326329 wait complete. 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 Processor -- start 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f05bdd56640 1 -- start start 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0076b0 0x7fe79c0379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c007a90 0x7fe79c0330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c0335e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0c5b30 con 0x7fe79c0076b0 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c032c10 con 0x7fe79c007a90 2024-09-13T17:21:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7fe7ab222640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0c96c0 con 0x7fe79c0ccbe0 2024-09-13T17:21:16.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- start start 2024-09-13T17:21:16.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea806b640 0x7f4ea80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea8145e80 0x7f4ea8147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8148ce0 0x7f4ea8147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b68f0 con 0x7f4ea8145e80 2024-09-13T17:21:16.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81486e0 con 0x7f4ea806b640 2024-09-13T17:21:16.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.514+0000 7f4ead2cc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8147260 con 0x7f4ea8148ce0 2024-09-13T17:21:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7feefb7fe640 1 --2- 172.21.15.167:0/587793827 >> v2:172.21.15.190:3300/0 conn(0x7feefc0b1920 0x7feefc146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea8145e80 0x7f4ea8147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea8145e80 0x7f4ea8147740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42482/0 (socket says 172.21.15.167:42482) 2024-09-13T17:21:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 -- 172.21.15.167:0/502415519 learned_addr learned my addr 172.21.15.167:0/502415519 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4ea6ffd640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea806b640 0x7f4ea80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe96dc39640 1 Processor -- start 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe96dc39640 1 -- start start 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bdd56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05b80b6770 0x7f05b8145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bdd56640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 0x7f05b81459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bdd56640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b813fb90 0x7f05b8140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bdd56640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8145070 con 0x7f05b80b6770 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bdd56640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8140930 con 0x7f05b813d9f0 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bdd56640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8144a80 con 0x7f05b813fb90 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05b80b6770 0x7f05b8145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05b80b6770 0x7f05b8145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42498/0 (socket says 172.21.15.167:42498) 2024-09-13T17:21:16.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 -- 172.21.15.167:0/3643003885 learned_addr learned my addr 172.21.15.167:0/3643003885 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7feefaffd640 1 -- 172.21.15.167:0/587793827 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221834740 0 0) 0x7feefc0aced0 con 0x7feefc0ada70 2024-09-13T17:21:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7feefaffd640 1 -- 172.21.15.167:0/587793827 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee4003530 con 0x7feefc0ada70 2024-09-13T17:21:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4ea77fe640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8148ce0 0x7f4ea8147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 -- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8148ce0 msgr2=0x7f4ea8147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8148ce0 0x7f4ea8147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 -- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea806b640 msgr2=0x7f4ea80b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea806b640 0x7f4ea80b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 -- 172.21.15.167:0/502415519 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0009b30 con 0x7f4ea8145e80 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c007a90 0x7fe79c0330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c007a90 0x7fe79c0330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41230/0 (socket says 172.21.15.167:41230) 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 -- 172.21.15.167:0/4182257147 learned_addr learned my addr 172.21.15.167:0/4182257147 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7aaa21640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c0335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7aa220640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0076b0 0x7fe79c0379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 -- 172.21.15.167:0/3060857451 wait complete. 2024-09-13T17:21:16.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bd555640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b813fb90 0x7f05b8140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7feefb7fe640 1 -- 172.21.15.167:0/587793827 >> v1:172.21.15.190:6789/0 conn(0x7feefc0ada70 legacy=0x7feefc147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 Processor -- start 2024-09-13T17:21:16.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7feefb7fe640 1 -- 172.21.15.167:0/587793827 >> v1:172.21.15.167:6789/0 conn(0x7feefc06b410 legacy=0x7feefc0ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f4e9ffff640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea8145e80 0x7f4ea8147740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800b4a0 tx=0x7f4e9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7feefb7fe640 1 -- 172.21.15.167:0/587793827 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0b2c80 con 0x7feefc0b1920 2024-09-13T17:21:16.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 -- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 msgr2=0x7fe79c0335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c0335e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 -- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0076b0 msgr2=0x7fe79c0379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0076b0 0x7fe79c0379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 -- 172.21.15.167:0/4182257147 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009420 con 0x7fe79c007a90 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7aaa21640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c0335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7aa220640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0076b0 0x7fe79c0379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe96dc39640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe96806c870 0x7fe968145b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe96dc39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe968146050 0x7fe968142a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe96dc39640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9681425a0 con 0x7fe968142fa0 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe96dc39640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96806cc50 con 0x7fe968146050 2024-09-13T17:21:16.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe96dc39640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe968146570 con 0x7fe96806c870 2024-09-13T17:21:16.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 -- 172.21.15.167:0/3643003885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b813fb90 msgr2=0x7f05b8140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b813fb90 0x7f05b8140020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 -- 172.21.15.167:0/3643003885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 msgr2=0x7f05b81459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 0x7f05b81459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 -- 172.21.15.167:0/3643003885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0094d0 con 0x7f05b80b6770 2024-09-13T17:21:16.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f05bcd54640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05b80b6770 0x7f05b8145490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0ae040 tx=0x7f05ac019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 -- start start 2024-09-13T17:21:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe966ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe968146050 0x7fe968142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d2806ab10 0x7f7d28150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d280acea0 0x7f7d281e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d280ad2d0 0x7f7d281df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2809c2c0 con 0x7f7d2806ab10 2024-09-13T17:21:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2809bb00 con 0x7f7d280acea0 2024-09-13T17:21:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2ce95640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2814bd50 con 0x7f7d280ad2d0 2024-09-13T17:21:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7a9a1f640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c007a90 0x7fe79c0330a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000c480 tx=0x7fe7a000c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe9677fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe96806c870 0x7fe968145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe966ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe968146050 0x7fe968142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42502/0 (socket says 172.21.15.167:42502) 2024-09-13T17:21:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe967fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe968142fa0 0x7fe96813c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.167:56784/0 (socket says 172.21.15.167:56784) 2024-09-13T17:21:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe966ffd640 1 -- 172.21.15.167:0/544517506 learned_addr learned my addr 172.21.15.167:0/544517506 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d2806ab10 0x7f7d28150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d2806ab10 0x7f7d28150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42504/0 (socket says 172.21.15.167:42504) 2024-09-13T17:21:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d2659c640 1 -- 172.21.15.167:0/357955196 learned_addr learned my addr 172.21.15.167:0/357955196 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe9677fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe96806c870 0x7fe968145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41242/0 (socket says 172.21.15.167:41242) 2024-09-13T17:21:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d26d9d640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d280ad2d0 0x7f7d281df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe79affd640 1 -- 172.21.15.167:0/4182257147 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0005cf0 con 0x7fe79c007a90 2024-09-13T17:21:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c16cba0 con 0x7fe79c007a90 2024-09-13T17:21:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c037f00 con 0x7fe79c007a90 2024-09-13T17:21:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe966ffd640 1 -- 172.21.15.167:0/544517506 >> v2:172.21.15.190:3300/0 conn(0x7fe96806c870 msgr2=0x7fe968145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:16.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d25d9b640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d280acea0 0x7f7d281e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe966ffd640 1 --2- 172.21.15.167:0/544517506 >> v2:172.21.15.190:3300/0 conn(0x7fe96806c870 0x7fe968145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe966ffd640 1 -- 172.21.15.167:0/544517506 >> v1:172.21.15.190:6789/0 conn(0x7fe968142fa0 legacy=0x7fe96813c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe966ffd640 1 -- 172.21.15.167:0/544517506 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe968146850 con 0x7fe968146050 2024-09-13T17:21:16.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe9677fe640 1 --2- 172.21.15.167:0/544517506 >> v2:172.21.15.190:3300/0 conn(0x7fe96806c870 0x7fe968145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:16.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe79affd640 1 -- 172.21.15.167:0/4182257147 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0005e50 con 0x7fe79c007a90 2024-09-13T17:21:16.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe79affd640 1 -- 172.21.15.167:0/4182257147 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00072b0 con 0x7fe79c007a90 2024-09-13T17:21:16.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d26d9d640 1 -- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d280acea0 msgr2=0x7f7d281e58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d26d9d640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d280acea0 0x7f7d281e58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d26d9d640 1 -- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d2806ab10 msgr2=0x7f7d28150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d26d9d640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d2806ab10 0x7f7d28150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7f7d26d9d640 1 -- 172.21.15.167:0/357955196 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0094d0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.518+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c005260 con 0x7fe79c007a90 2024-09-13T17:21:16.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f7d26d9d640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d280ad2d0 0x7f7d281df1c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d280ad6f0 tx=0x7f7d2000cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f7d16ffd640 1 -- 172.21.15.167:0/357955196 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20003b80 con 0x7f7d280ad2d0 2024-09-13T17:21:16.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f7d16ffd640 1 -- 172.21.15.167:0/357955196 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d20003ce0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f91037fe640 1 -- 172.21.15.167:0/1345075212 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9110050a60 con 0x7f911c147130 2024-09-13T17:21:16.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e62ffd640 1 -- 172.21.15.167:0/1397409092 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580ab5f0 con 0x7f6e5c031820 2024-09-13T17:21:16.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e62ffd640 1 -- 172.21.15.167:0/1397409092 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e580ab750 con 0x7f6e5c031820 2024-09-13T17:21:16.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e62ffd640 1 -- 172.21.15.167:0/1397409092 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580abac0 con 0x7f6e5c031820 2024-09-13T17:21:16.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f7d16ffd640 1 -- 172.21.15.167:0/357955196 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20005270 con 0x7f7d280ad2d0 2024-09-13T17:21:16.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05b57fa640 1 -- 172.21.15.167:0/3643003885 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac003c70 con 0x7f05b80b6770 2024-09-13T17:21:16.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b809c780 con 0x7f05b80b6770 2024-09-13T17:21:16.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b809c400 con 0x7f05b80b6770 2024-09-13T17:21:16.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7feefb7fe640 1 --2- 172.21.15.167:0/587793827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc0b1920 0x7feefc146c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feef4009d90 tx=0x7feef401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b635777607a1ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f4e9f7fe640 1 -- 172.21.15.167:0/502415519 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98010610 con 0x7f4ea8145e80 2024-09-13T17:21:16.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f4e9f7fe640 1 -- 172.21.15.167:0/502415519 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e98010770 con 0x7f4ea8145e80 2024-09-13T17:21:16.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f4e9f7fe640 1 -- 172.21.15.167:0/502415519 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98010b60 con 0x7f4ea8145e80 2024-09-13T17:21:16.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1397409092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 msgr2=0x7f6e5c038fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1397409092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c038fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e5801c3f0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7fe79affd640 1 -- 172.21.15.167:0/4182257147 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7a0007410 con 0x7fe79c007a90 2024-09-13T17:21:16.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7fe79affd640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe788066690 0x7fe788068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7fe79affd640 1 -- 172.21.15.167:0/4182257147 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7a0084a60 con 0x7fe79c007a90 2024-09-13T17:21:16.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7fe7aa220640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe788066690 0x7fe788068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2814c790 con 0x7f7d280ad2d0 2024-09-13T17:21:16.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2814ba70 con 0x7f7d280ad2d0 2024-09-13T17:21:16.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7fe7aa220640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe788066690 0x7fe788068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7940ad000 tx=0x7fe7940a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2809bfe0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1397409092 shutdown_connections 2024-09-13T17:21:16.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1397409092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c038fe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1397409092 >> 172.21.15.167:0/1397409092 conn(0x7f6e5c03b070 msgr2=0x7f6e5c03b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05b57fa640 1 -- 172.21.15.167:0/3643003885 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac003dd0 con 0x7f05b80b6770 2024-09-13T17:21:16.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05b57fa640 1 -- 172.21.15.167:0/3643003885 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0be660 con 0x7f05b80b6770 2024-09-13T17:21:16.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0598005260 con 0x7f05b80b6770 2024-09-13T17:21:16.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea8148360 con 0x7f4ea8145e80 2024-09-13T17:21:16.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea80ae400 con 0x7f4ea8145e80 2024-09-13T17:21:16.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05b57fa640 1 -- 172.21.15.167:0/3643003885 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05ac0b2040 con 0x7f05b80b6770 2024-09-13T17:21:16.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea81473f0 con 0x7f4ea8145e80 2024-09-13T17:21:16.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05b57fa640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f059c066690 0x7f059c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f05b57fa640 1 -- 172.21.15.167:0/3643003885 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f05ac11e2e0 con 0x7f05b80b6770 2024-09-13T17:21:16.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.522+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1397409092 shutdown_connections 2024-09-13T17:21:16.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1397409092 wait complete. 2024-09-13T17:21:16.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f05b7fff640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f059c066690 0x7f059c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f05b7fff640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f059c066690 0x7f059c068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05b8071b00 tx=0x7f05a4006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7fe966ffd640 1 --2- 172.21.15.167:0/544517506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968146050 0x7fe968142a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe9680b3bd0 tx=0x7fe95401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33696afbce76a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 Processor -- start 2024-09-13T17:21:16.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 -- start start 2024-09-13T17:21:16.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c01f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e5c03a740 0x7f6e5c169080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f7d16ffd640 1 -- 172.21.15.167:0/357955196 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d200053d0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5c0ca340 0x7f6e5c1695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c01e4e0 con 0x7f6e5c031820 2024-09-13T17:21:16.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c01e1d0 con 0x7f6e5c03a740 2024-09-13T17:21:16.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e6aa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c020780 con 0x7f6e5c0ca340 2024-09-13T17:21:16.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c01f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c01f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42520/0 (socket says 172.21.15.167:42520) 2024-09-13T17:21:16.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e63fff640 1 -- 172.21.15.167:0/1380564859 learned_addr learned my addr 172.21.15.167:0/1380564859 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e637fe640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e5c03a740 0x7f6e5c169080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e68f9d640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5c0ca340 0x7f6e5c1695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f7d16ffd640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d08066690 0x7f7d08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f7d16ffd640 1 -- 172.21.15.167:0/357955196 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d20083eb0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f7d2659c640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d08066690 0x7f7d08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f4e9f7fe640 1 -- 172.21.15.167:0/502415519 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e98010cc0 con 0x7f4ea8145e80 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f4e9f7fe640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4e88066760 0x7f4e88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f4e9f7fe640 1 -- 172.21.15.167:0/502415519 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e98084560 con 0x7f4ea8145e80 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f4ea6ffd640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4e88066760 0x7f4e88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e637fe640 1 -- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5c0ca340 msgr2=0x7f6e5c1695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e637fe640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5c0ca340 0x7f6e5c1695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e637fe640 1 -- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 msgr2=0x7f6e5c01f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e637fe640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c01f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e637fe640 1 -- 172.21.15.167:0/1380564859 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58009420 con 0x7f6e5c03a740 2024-09-13T17:21:16.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f4ea6ffd640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4e88066760 0x7f4e88068c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e90006fd0 tx=0x7f4e90009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f6e637fe640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e5c03a740 0x7f6e5c169080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c3e0 tx=0x7f6e5000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.526+0000 7f7d2659c640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d08066690 0x7f7d08068b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009c20 tx=0x7f7d18009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.530+0000 7f05b57fa640 1 -- 172.21.15.167:0/3643003885 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05ac0eb330 con 0x7f05b80b6770 2024-09-13T17:21:16.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7feefaffd640 1 -- 172.21.15.167:0/587793827 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef40a59a0 con 0x7feefc0b1920 2024-09-13T17:21:16.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7f6e60ff9640 1 -- 172.21.15.167:0/1380564859 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50011790 con 0x7f6e5c03a740 2024-09-13T17:21:16.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7f6e60ff9640 1 -- 172.21.15.167:0/1380564859 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e500118f0 con 0x7f6e5c03a740 2024-09-13T17:21:16.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7f6e60ff9640 1 -- 172.21.15.167:0/1380564859 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50011ce0 con 0x7f6e5c03a740 2024-09-13T17:21:16.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c01eb60 con 0x7f6e5c03a740 2024-09-13T17:21:16.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7feefaffd640 1 -- 172.21.15.167:0/587793827 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef40a5b00 con 0x7feefc0b1920 2024-09-13T17:21:16.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7feefaffd640 1 -- 172.21.15.167:0/587793827 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef40a59a0 con 0x7feefc0b1920 2024-09-13T17:21:16.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c0202e0 con 0x7f6e5c03a740 2024-09-13T17:21:16.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7fe79affd640 1 -- 172.21.15.167:0/4182257147 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7a0051c10 con 0x7fe79c007a90 2024-09-13T17:21:16.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7fef01399640 1 -- 172.21.15.167:0/587793827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc0b1920 msgr2=0x7feefc146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7fef01399640 1 --2- 172.21.15.167:0/587793827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc0b1920 0x7feefc146c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feef4009d90 tx=0x7feef401c8e0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.534+0000 7fe9667fc640 1 -- 172.21.15.167:0/544517506 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9540ab600 con 0x7fe968146050 2024-09-13T17:21:16.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7f4e9f7fe640 1 -- 172.21.15.167:0/502415519 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e98051700 con 0x7f4ea8145e80 2024-09-13T17:21:16.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- 172.21.15.167:0/587793827 shutdown_connections 2024-09-13T17:21:16.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 --2- 172.21.15.167:0/587793827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc0b1920 0x7feefc146c00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe9667fc640 1 -- 172.21.15.167:0/544517506 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9540a7050 con 0x7fe968146050 2024-09-13T17:21:16.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- 172.21.15.167:0/587793827 >> 172.21.15.167:0/587793827 conn(0x7feefc0b70f0 msgr2=0x7feefc0b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c038fe0 con 0x7f6e5c03a740 2024-09-13T17:21:16.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- 172.21.15.167:0/587793827 shutdown_connections 2024-09-13T17:21:16.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 -- 172.21.15.167:0/544517506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968146050 msgr2=0x7fe968142a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 --2- 172.21.15.167:0/544517506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968146050 0x7fe968142a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe9680b3bd0 tx=0x7fe95401c490 comp rx=0 tx=0).stop 2024-09-13T17:21:16.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 -- 172.21.15.167:0/544517506 shutdown_connections 2024-09-13T17:21:16.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 --2- 172.21.15.167:0/544517506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968146050 0x7fe968142a60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 --2- 172.21.15.167:0/544517506 >> v2:172.21.15.190:3300/0 conn(0x7fe96806c870 0x7fe968145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 -- 172.21.15.167:0/544517506 >> 172.21.15.167:0/544517506 conn(0x7fe9680b83c0 msgr2=0x7fe9680b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 -- 172.21.15.167:0/544517506 shutdown_connections 2024-09-13T17:21:16.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- 172.21.15.167:0/587793827 wait complete. 2024-09-13T17:21:16.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 Processor -- start 2024-09-13T17:21:16.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7f6e60ff9640 1 -- 172.21.15.167:0/1380564859 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e5001c460 con 0x7f6e5c03a740 2024-09-13T17:21:16.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7f6e60ff9640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e480666c0 0x7f6e48068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7f6e60ff9640 1 -- 172.21.15.167:0/1380564859 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e50084bf0 con 0x7f6e5c03a740 2024-09-13T17:21:16.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 -- 172.21.15.167:0/544517506 wait complete. 2024-09-13T17:21:16.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 Processor -- start 2024-09-13T17:21:16.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- start start 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc06b410 0x7feefc0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0ada70 0x7feefc143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feefc0b1920 0x7feefc1443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc147d70 con 0x7feefc0ada70 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc11f1b0 con 0x7feefc06b410 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fef01399640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc11f490 con 0x7feefc0b1920 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7feefbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc06b410 0x7feefc0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7feefbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc06b410 0x7feefc0b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:41268/0 (socket says 172.21.15.167:41268) 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7feefbfff640 1 -- 172.21.15.167:0/1123941353 learned_addr learned my addr 172.21.15.167:0/1123941353 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7feefb7fe640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0ada70 0x7feefc143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.538+0000 7fe96dc39640 1 -- start start 2024-09-13T17:21:16.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe96806c870 0x7fe96813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe968142fa0 0x7fe9681449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe968146050 0x7fe96813dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96813f2d0 con 0x7fe96806c870 2024-09-13T17:21:16.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96813d260 con 0x7fe968146050 2024-09-13T17:21:16.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9680b7da0 con 0x7fe968142fa0 2024-09-13T17:21:16.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7feefb7fe640 1 -- 172.21.15.167:0/1123941353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feefc0b1920 msgr2=0x7feefc1443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7feefb7fe640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feefc0b1920 0x7feefc1443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7feefb7fe640 1 -- 172.21.15.167:0/1123941353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc06b410 msgr2=0x7feefc0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7feefb7fe640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc06b410 0x7feefc0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7feefb7fe640 1 -- 172.21.15.167:0/1123941353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef4009a70 con 0x7feefc0ada70 2024-09-13T17:21:16.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe96806c870 0x7fe96813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe96806c870 0x7fe96813fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42548/0 (socket says 172.21.15.167:42548) 2024-09-13T17:21:16.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 -- 172.21.15.167:0/633829752 learned_addr learned my addr 172.21.15.167:0/633829752 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:16.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe967fff640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe968146050 0x7fe96813dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7feefb7fe640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0ada70 0x7feefc143e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feef40ac000 tx=0x7feef4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7f6e63fff640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e480666c0 0x7f6e48068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7f7d16ffd640 1 -- 172.21.15.167:0/357955196 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d20051050 con 0x7f7d280ad2d0 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe966ffd640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe968142fa0 0x7fe9681449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 -- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe968142fa0 msgr2=0x7fe9681449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe968142fa0 0x7fe9681449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 -- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe968146050 msgr2=0x7fe96813dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe968146050 0x7fe96813dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 -- 172.21.15.167:0/633829752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c00b6c0 con 0x7fe96806c870 2024-09-13T17:21:16.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe9677fe640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe96806c870 0x7fe96813fc80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00ed40 tx=0x7fe95c00d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe953fff640 1 -- 172.21.15.167:0/633829752 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c010850 con 0x7fe96806c870 2024-09-13T17:21:16.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7f6e63fff640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e480666c0 0x7f6e48068b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801c430 tx=0x7f6e580a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe953fff640 1 -- 172.21.15.167:0/633829752 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c0109b0 con 0x7fe96806c870 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe953fff640 1 -- 172.21.15.167:0/633829752 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c010d20 con 0x7fe96806c870 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9540094d0 con 0x7fe96806c870 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9680b7a30 con 0x7fe96806c870 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.542+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96813fa40 con 0x7fe96806c870 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.546+0000 7fe953fff640 1 -- 172.21.15.167:0/633829752 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe95c0183e0 con 0x7fe96806c870 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.546+0000 7fe953fff640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe94c0666e0 0x7fe94c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.546+0000 7fe953fff640 1 -- 172.21.15.167:0/633829752 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe95c014030 con 0x7fe96806c870 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.546+0000 7fe966ffd640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe94c0666e0 0x7fe94c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.546+0000 7fe966ffd640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe94c0666e0 0x7fe94c068ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9540ad000 tx=0x7fe9540a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.550+0000 7feef8ff9640 1 -- 172.21.15.167:0/1123941353 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4004450 con 0x7feefc0ada70 2024-09-13T17:21:16.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.550+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc11f770 con 0x7feefc0ada70 2024-09-13T17:21:16.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.550+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc0b0590 con 0x7feefc0ada70 2024-09-13T17:21:16.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.550+0000 7feef8ff9640 1 -- 172.21.15.167:0/1123941353 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef40045b0 con 0x7feefc0ada70 2024-09-13T17:21:16.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.550+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc11f9b0 con 0x7feefc0ada70 2024-09-13T17:21:16.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.550+0000 7feef8ff9640 1 -- 172.21.15.167:0/1123941353 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4009450 con 0x7feefc0ada70 2024-09-13T17:21:16.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.550+0000 7f6e60ff9640 1 -- 172.21.15.167:0/1380564859 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e50051d90 con 0x7f6e5c03a740 2024-09-13T17:21:16.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.554+0000 7fe953fff640 1 -- 172.21.15.167:0/633829752 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe95c051b10 con 0x7fe96806c870 2024-09-13T17:21:16.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.554+0000 7feef8ff9640 1 -- 172.21.15.167:0/1123941353 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feef40b4030 con 0x7feefc0ada70 2024-09-13T17:21:16.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.558+0000 7feef8ff9640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feee80666e0 0x7feee8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:16.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.558+0000 7feef8ff9640 1 -- 172.21.15.167:0/1123941353 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feef411fb20 con 0x7feefc0ada70 2024-09-13T17:21:16.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.558+0000 7feefbfff640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feee80666e0 0x7feee8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:16.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.558+0000 7feefbfff640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feee80666e0 0x7feee8068ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feeec0018b0 tx=0x7feeec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:16.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.566+0000 7feef8ff9640 1 -- 172.21.15.167:0/1123941353 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feef40ecee0 con 0x7feefc0ada70 2024-09-13T17:21:16.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.834+0000 7f91216fc640 1 -- 172.21.15.167:0/1345075212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f911c145d30 con 0x7f911c147130 2024-09-13T17:21:16.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.834+0000 7f91037fe640 1 -- 172.21.15.167:0/1345075212 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9110018090 con 0x7f911c147130 2024-09-13T17:21:16.839 INFO:teuthology.orchestra.run.smithi167.stdout:55834574858 2024-09-13T17:21:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 -- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f91080666c0 msgr2=0x7f9108068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f91080666c0 0x7f9108068b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ad000 tx=0x7f910c008040 comp rx=0 tx=0).stop 2024-09-13T17:21:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 -- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f911c147130 msgr2=0x7f911c141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f911c147130 0x7f911c141300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f911000c470 tx=0x7f911000c930 comp rx=0 tx=0).stop 2024-09-13T17:21:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 -- 172.21.15.167:0/1345075212 shutdown_connections 2024-09-13T17:21:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f91080666c0 0x7f9108068b80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f911c147130 0x7f911c141300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f911c099380 0x7f911c147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 --2- 172.21.15.167:0/1345075212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f911c098a40 0x7f911c070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 -- 172.21.15.167:0/1345075212 >> 172.21.15.167:0/1345075212 conn(0x7f911c06a660 msgr2=0x7f911c0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 -- 172.21.15.167:0/1345075212 shutdown_connections 2024-09-13T17:21:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.838+0000 7f91017fa640 1 -- 172.21.15.167:0/1345075212 wait complete. 2024-09-13T17:21:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.846+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f05980050d0 con 0x7f05b80b6770 2024-09-13T17:21:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05b57fa640 1 -- 172.21.15.167:0/3643003885 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05ac0ee950 con 0x7f05b80b6770 2024-09-13T17:21:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7d2809bfe0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.853 INFO:teuthology.orchestra.run.smithi167.stdout:64424509448 2024-09-13T17:21:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4ea8145770 con 0x7f4ea8145e80 2024-09-13T17:21:16.854 INFO:teuthology.orchestra.run.smithi167.stdout:64424509448 2024-09-13T17:21:16.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f7d16ffd640 1 -- 172.21.15.167:0/357955196 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d2809bfe0 con 0x7f7d280ad2d0 2024-09-13T17:21:16.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f4e9f7fe640 1 -- 172.21.15.167:0/502415519 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e98014020 con 0x7f4ea8145e80 2024-09-13T17:21:16.854 INFO:teuthology.orchestra.run.smithi167.stdout:64424509448 2024-09-13T17:21:16.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe78c0057e0 con 0x7fe79c007a90 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f059c066690 msgr2=0x7f059c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f059c066690 0x7f059c068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05b8071b00 tx=0x7f05a4006ca0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05b80b6770 msgr2=0x7f05b8145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05b80b6770 0x7f05b8145490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0ae040 tx=0x7f05ac019250 comp rx=0 tx=0).stop 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 shutdown_connections 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f059c066690 0x7f059c068b50 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05b8071b00 tx=0x7f05a4006ca0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05b813fb90 0x7f05b8140020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05b813d9f0 0x7f05b81459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 --2- 172.21.15.167:0/3643003885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05b80b6770 0x7f05b8145490 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.850+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 >> 172.21.15.167:0/3643003885 conn(0x7f05b80b5c50 msgr2=0x7f05b813cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7fe79affd640 1 -- 172.21.15.167:0/4182257147 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7a0055230 con 0x7fe79c007a90 2024-09-13T17:21:16.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4e88066760 msgr2=0x7f4e88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4e88066760 0x7f4e88068c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e90006fd0 tx=0x7f4e90009060 comp rx=0 tx=0).stop 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea8145e80 msgr2=0x7f4ea8147740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea8145e80 0x7f4ea8147740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800b4a0 tx=0x7f4e9800b960 comp rx=0 tx=0).stop 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 shutdown_connections 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4e88066760 0x7f4e88068c20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ea8148ce0 0x7f4ea8147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea8145e80 0x7f4ea8147740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 --2- 172.21.15.167:0/502415519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ea806b640 0x7f4ea80b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 >> 172.21.15.167:0/502415519 conn(0x7f4ea80b7420 msgr2=0x7f4ea80adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 shutdown_connections 2024-09-13T17:21:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f4ead2cc640 1 -- 172.21.15.167:0/502415519 wait complete. 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d08066690 msgr2=0x7f7d08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d08066690 0x7f7d08068b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009c20 tx=0x7f7d18009190 comp rx=0 tx=0).stop 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d280ad2d0 msgr2=0x7f7d281df1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d280ad2d0 0x7f7d281df1c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d280ad6f0 tx=0x7f7d2000cbe0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 shutdown_connections 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7d08066690 0x7f7d08068b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d280ad2d0 0x7f7d281df1c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d280acea0 0x7f7d281e58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 --2- 172.21.15.167:0/357955196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d2806ab10 0x7f7d28150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 >> 172.21.15.167:0/357955196 conn(0x7f7d2806a660 msgr2=0x7f7d2813f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 shutdown_connections 2024-09-13T17:21:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f7d2ce95640 1 -- 172.21.15.167:0/357955196 wait complete. 2024-09-13T17:21:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 shutdown_connections 2024-09-13T17:21:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7f05bdd56640 1 -- 172.21.15.167:0/3643003885 wait complete. 2024-09-13T17:21:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe788066690 msgr2=0x7fe788068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7fe7ab222640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe788066690 0x7fe788068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7940ad000 tx=0x7fe7940a6000 comp rx=0 tx=0).stop 2024-09-13T17:21:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c007a90 msgr2=0x7fe79c0330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.854+0000 7fe7ab222640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c007a90 0x7fe79c0330a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000c480 tx=0x7fe7a000c940 comp rx=0 tx=0).stop 2024-09-13T17:21:16.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.858+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 shutdown_connections 2024-09-13T17:21:16.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.858+0000 7fe7ab222640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe788066690 0x7fe788068b50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.858+0000 7fe7ab222640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe79c0ccbe0 0x7fe79c0335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.858+0000 7fe7ab222640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe79c007a90 0x7fe79c0330a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.858+0000 7fe7ab222640 1 --2- 172.21.15.167:0/4182257147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0076b0 0x7fe79c0379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.858+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 >> 172.21.15.167:0/4182257147 conn(0x7fe79c03a7d0 msgr2=0x7fe79c03d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-09-13T17:21:16.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.862+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 shutdown_connections 2024-09-13T17:21:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.862+0000 7fe7ab222640 1 -- 172.21.15.167:0/4182257147 wait complete. 2024-09-13T17:21:16.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.874+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe96814cc20 con 0x7fe96806c870 2024-09-13T17:21:16.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.874+0000 7fe953fff640 1 -- 172.21.15.167:0/633829752 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe95c055130 con 0x7fe96806c870 2024-09-13T17:21:16.877 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2024-09-13T17:21:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe94c0666e0 msgr2=0x7fe94c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe94c0666e0 0x7fe94c068ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9540ad000 tx=0x7fe9540a6000 comp rx=0 tx=0).stop 2024-09-13T17:21:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe96806c870 msgr2=0x7fe96813fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe96806c870 0x7fe96813fc80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00ed40 tx=0x7fe95c00d720 comp rx=0 tx=0).stop 2024-09-13T17:21:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 shutdown_connections 2024-09-13T17:21:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fe94c0666e0 0x7fe94c068ba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe968146050 0x7fe96813dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe968142fa0 0x7fe9681449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 --2- 172.21.15.167:0/633829752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe96806c870 0x7fe96813fc80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 >> 172.21.15.167:0/633829752 conn(0x7fe9680b83c0 msgr2=0x7fe968138fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 shutdown_connections 2024-09-13T17:21:16.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7fe96dc39640 1 -- 172.21.15.167:0/633829752 wait complete. 2024-09-13T17:21:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.878+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6e5c03d5e0 con 0x7f6e5c03a740 2024-09-13T17:21:16.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.882+0000 7f6e60ff9640 1 -- 172.21.15.167:0/1380564859 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e500553b0 con 0x7f6e5c03a740 2024-09-13T17:21:16.884 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e480666c0 msgr2=0x7f6e48068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e480666c0 0x7f6e48068b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801c430 tx=0x7f6e580a7000 comp rx=0 tx=0).stop 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e5c03a740 msgr2=0x7f6e5c169080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e5c03a740 0x7f6e5c169080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c3e0 tx=0x7f6e5000c8a0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 shutdown_connections 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6e480666c0 0x7f6e48068b80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6e5c0ca340 0x7f6e5c1695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e5c03a740 0x7f6e5c169080 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 --2- 172.21.15.167:0/1380564859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e5c031820 0x7f6e5c01f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 >> 172.21.15.167:0/1380564859 conn(0x7f6e5c03b070 msgr2=0x7f6e5c004f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-09-13T17:21:16.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-09-13T17:21:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 shutdown_connections 2024-09-13T17:21:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7f6e6aa00640 1 -- 172.21.15.167:0/1380564859 wait complete. 2024-09-13T17:21:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feefc11f9b0 con 0x7feefc0ada70 2024-09-13T17:21:16.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-09-13T17:21:16.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.886+0000 7feef8ff9640 1 -- 172.21.15.167:0/1123941353 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feefc11f9b0 con 0x7feefc0ada70 2024-09-13T17:21:16.892 INFO:teuthology.orchestra.run.smithi167.stdout:64424509449 2024-09-13T17:21:16.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feee80666e0 msgr2=0x7feee8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feee80666e0 0x7feee8068ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feeec0018b0 tx=0x7feeec009040 comp rx=0 tx=0).stop 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0ada70 msgr2=0x7feefc143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0ada70 0x7feefc143e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feef40ac000 tx=0x7feef4019680 comp rx=0 tx=0).stop 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 shutdown_connections 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feee80666e0 0x7feee8068ba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feefc0b1920 0x7feefc1443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0ada70 0x7feefc143e60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 --2- 172.21.15.167:0/1123941353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feefc06b410 0x7feefc0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 >> 172.21.15.167:0/1123941353 conn(0x7feefc0b70f0 msgr2=0x7feefc0b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 shutdown_connections 2024-09-13T17:21:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:16.890+0000 7fef01399640 1 -- 172.21.15.167:0/1123941353 wait complete. 2024-09-13T17:21:16.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2024-09-13T17:21:16.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2024-09-13T17:21:16.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-09-13T17:21:16.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-09-13T17:21:17.865 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:21:17.890 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:21:17.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:21:17.892 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:21:17.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:21:17.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:21:17.912 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:21:17.913 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:21:18.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2617e6a640 1 Processor -- start 2024-09-13T17:21:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2617e6a640 1 -- start start 2024-09-13T17:21:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2617e6a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f261006b410 0x7f26100acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2617e6a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2610098a40 0x7f2610098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2617e6a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26100ac730 con 0x7f26100993b0 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2617e6a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100ac1e0 con 0x7f261006b410 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2617e6a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2610099840 con 0x7f2610098a40 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2615c06640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f261006b410 0x7f26100acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2615c06640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f261006b410 0x7f26100acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45978/0 (socket says 172.21.15.167:45978) 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2615c06640 1 -- 172.21.15.167:0/1434681737 learned_addr learned my addr 172.21.15.167:0/1434681737 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.042+0000 7f2615405640 1 --2- 172.21.15.167:0/1434681737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2610098a40 0x7f2610098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.046+0000 7f2615405640 1 -- 172.21.15.167:0/1434681737 >> v2:172.21.15.167:3300/0 conn(0x7f261006b410 msgr2=0x7f26100acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.046+0000 7f2615405640 1 --2- 172.21.15.167:0/1434681737 >> v2:172.21.15.167:3300/0 conn(0x7f261006b410 0x7f26100acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.046+0000 7f2615405640 1 -- 172.21.15.167:0/1434681737 >> v1:172.21.15.167:6789/0 conn(0x7f26100993b0 legacy=0x7f2610141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.046+0000 7f2615405640 1 -- 172.21.15.167:0/1434681737 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261006b7f0 con 0x7f2610098a40 2024-09-13T17:21:18.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.046+0000 7f2615c06640 1 --2- 172.21.15.167:0/1434681737 >> v2:172.21.15.167:3300/0 conn(0x7f261006b410 0x7f26100acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:18.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.046+0000 7f2615405640 1 --2- 172.21.15.167:0/1434681737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2610098a40 0x7f2610098e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f260800c480 tx=0x7f260801d010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526b4cce3b533a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.046+0000 7f2614c04640 1 -- 172.21.15.167:0/1434681737 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26080ac600 con 0x7f2610098a40 2024-09-13T17:21:18.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2614c04640 1 -- 172.21.15.167:0/1434681737 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26080a8050 con 0x7f2610098a40 2024-09-13T17:21:18.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2614c04640 1 -- 172.21.15.167:0/1434681737 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26080ac980 con 0x7f2610098a40 2024-09-13T17:21:18.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 -- 172.21.15.167:0/1434681737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2610098a40 msgr2=0x7f2610098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 --2- 172.21.15.167:0/1434681737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2610098a40 0x7f2610098e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f260800c480 tx=0x7f260801d010 comp rx=0 tx=0).stop 2024-09-13T17:21:18.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 -- 172.21.15.167:0/1434681737 shutdown_connections 2024-09-13T17:21:18.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 --2- 172.21.15.167:0/1434681737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2610098a40 0x7f2610098e70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 --2- 172.21.15.167:0/1434681737 >> v2:172.21.15.167:3300/0 conn(0x7f261006b410 0x7f26100acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 -- 172.21.15.167:0/1434681737 >> 172.21.15.167:0/1434681737 conn(0x7f261006a660 msgr2=0x7f26100b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 -- 172.21.15.167:0/1434681737 shutdown_connections 2024-09-13T17:21:18.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 -- 172.21.15.167:0/1434681737 wait complete. 2024-09-13T17:21:18.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 Processor -- start 2024-09-13T17:21:18.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.050+0000 7f2617e6a640 1 -- start start 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f261006b410 0x7f2610070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2610098a40 0x7f2610147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26100993b0 0x7f2610146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261014be80 con 0x7f261006b410 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2610071620 con 0x7f2610098a40 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261014bc30 con 0x7f26100993b0 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f261006b410 0x7f2610070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f261006b410 0x7f2610070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45982/0 (socket says 172.21.15.167:45982) 2024-09-13T17:21:18.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 -- 172.21.15.167:0/1191295967 learned_addr learned my addr 172.21.15.167:0/1191295967 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615405640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2610098a40 0x7f2610147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2616407640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26100993b0 0x7f2610146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 -- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26100993b0 msgr2=0x7f2610146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26100993b0 0x7f2610146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 -- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2610098a40 msgr2=0x7f2610147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2610098a40 0x7f2610147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 -- 172.21.15.167:0/1191295967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0094d0 con 0x7f261006b410 2024-09-13T17:21:18.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2615c06640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f261006b410 0x7f2610070d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f260c00ea00 tx=0x7f260c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f26067fc640 1 -- 172.21.15.167:0/1191295967 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00ca60 con 0x7f261006b410 2024-09-13T17:21:18.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 -- 172.21.15.167:0/1191295967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260800c0e0 con 0x7f261006b410 2024-09-13T17:21:18.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.054+0000 7f2617e6a640 1 -- 172.21.15.167:0/1191295967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261006ff10 con 0x7f261006b410 2024-09-13T17:21:18.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.058+0000 7f2617e6a640 1 -- 172.21.15.167:0/1191295967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2610148510 con 0x7f261006b410 2024-09-13T17:21:18.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.058+0000 7f26067fc640 1 -- 172.21.15.167:0/1191295967 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c00cbc0 con 0x7f261006b410 2024-09-13T17:21:18.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.058+0000 7f26067fc640 1 -- 172.21.15.167:0/1191295967 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c013470 con 0x7f261006b410 2024-09-13T17:21:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.062+0000 7f26067fc640 1 -- 172.21.15.167:0/1191295967 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f260c0135d0 con 0x7f261006b410 2024-09-13T17:21:18.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.062+0000 7f26067fc640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25f4066790 0x7f25f4068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.062+0000 7f26067fc640 1 -- 172.21.15.167:0/1191295967 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f260c084660 con 0x7f261006b410 2024-09-13T17:21:18.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.062+0000 7f2615405640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25f4066790 0x7f25f4068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.062+0000 7f2615405640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25f4066790 0x7f25f4068c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26080ae000 tx=0x7f2608007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.070+0000 7f26067fc640 1 -- 172.21.15.167:0/1191295967 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f260c051800 con 0x7f261006b410 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.074+0000 7f9c3e655640 1 Processor -- start 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.074+0000 7f9c3e655640 1 -- start start 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3e655640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c3001bde0 0x7f9c30037e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3e655640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3001c400 con 0x7f9c30009bf0 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3e655640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3001af10 con 0x7f9c3001b3a0 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3e655640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3001d3c0 con 0x7f9c3001bde0 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3de54640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c3001bde0 0x7f9c30037e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3de54640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c3001bde0 0x7f9c30037e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45986/0 (socket says 172.21.15.167:45986) 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3de54640 1 -- 172.21.15.167:0/3788333858 learned_addr learned my addr 172.21.15.167:0/3788333858 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3de54640 1 -- 172.21.15.167:0/3788333858 >> v1:172.21.15.190:6789/0 conn(0x7f9c3001b3a0 legacy=0x7f9c300ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3de54640 1 -- 172.21.15.167:0/3788333858 >> v1:172.21.15.167:6789/0 conn(0x7f9c30009bf0 legacy=0x7f9c300ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c3de54640 1 -- 172.21.15.167:0/3788333858 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300edfd0 con 0x7f9c3001bde0 2024-09-13T17:21:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.078+0000 7f9c2ffff640 1 -- 172.21.15.167:0/3788333858 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814659361 0 0) 0x7f9c3001c400 con 0x7f9c30009bf0 2024-09-13T17:21:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3de54640 1 --2- 172.21.15.167:0/3788333858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c30037e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c38068cd0 tx=0x7f9c38089770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e307773ef2312e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c2ffff640 1 -- 172.21.15.167:0/3788333858 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c381166e0 con 0x7f9c3001bde0 2024-09-13T17:21:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c2ffff640 1 -- 172.21.15.167:0/3788333858 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38116840 con 0x7f9c3001bde0 2024-09-13T17:21:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c2ffff640 1 -- 172.21.15.167:0/3788333858 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38116bb0 con 0x7f9c3001bde0 2024-09-13T17:21:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3e655640 1 -- 172.21.15.167:0/3788333858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 msgr2=0x7f9c30037e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3e655640 1 --2- 172.21.15.167:0/3788333858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c30037e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c38068cd0 tx=0x7f9c38089770 comp rx=0 tx=0).stop 2024-09-13T17:21:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3e655640 1 -- 172.21.15.167:0/3788333858 shutdown_connections 2024-09-13T17:21:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3e655640 1 --2- 172.21.15.167:0/3788333858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c30037e30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3e655640 1 -- 172.21.15.167:0/3788333858 >> 172.21.15.167:0/3788333858 conn(0x7f9c30008e70 msgr2=0x7f9c30009280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3e655640 1 -- 172.21.15.167:0/3788333858 shutdown_connections 2024-09-13T17:21:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.082+0000 7f9c3e655640 1 -- 172.21.15.167:0/3788333858 wait complete. 2024-09-13T17:21:18.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 Processor -- start 2024-09-13T17:21:18.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 -- start start 2024-09-13T17:21:18.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c30009bf0 0x7f9c300e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c3001b3a0 0x7f9c30182280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c301827c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300ecaa0 con 0x7f9c3001bde0 2024-09-13T17:21:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300e9360 con 0x7f9c3001b3a0 2024-09-13T17:21:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3e655640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300e9ac0 con 0x7f9c30009bf0 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c301827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c301827c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46000/0 (socket says 172.21.15.167:46000) 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 -- 172.21.15.167:0/2720342317 learned_addr learned my addr 172.21.15.167:0/2720342317 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3ce52640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c3001b3a0 0x7f9c30182280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3d653640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c30009bf0 0x7f9c300e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 -- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c30009bf0 msgr2=0x7f9c300e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c30009bf0 0x7f9c300e8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 -- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c3001b3a0 msgr2=0x7f9c30182280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c3001b3a0 0x7f9c30182280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3de54640 1 -- 172.21.15.167:0/2720342317 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300e9630 con 0x7f9c3001bde0 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3ce52640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c3001b3a0 0x7f9c30182280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7f9c3d653640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c30009bf0 0x7f9c300e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c3de54640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c301827c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c38066da0 tx=0x7f9c38086510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c2dffb640 1 -- 172.21.15.167:0/2720342317 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38124070 con 0x7f9c3001bde0 2024-09-13T17:21:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c2dffb640 1 -- 172.21.15.167:0/2720342317 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38116e70 con 0x7f9c3001bde0 2024-09-13T17:21:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c300ea580 con 0x7f9c3001bde0 2024-09-13T17:21:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c2dffb640 1 -- 172.21.15.167:0/2720342317 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3811f650 con 0x7f9c3001bde0 2024-09-13T17:21:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c300e86b0 con 0x7f9c3001bde0 2024-09-13T17:21:18.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7fbf03071640 1 Processor -- start 2024-09-13T17:21:18.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.086+0000 7fbf03071640 1 -- start start 2024-09-13T17:21:18.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf03071640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc0890c0 0x7fbefc089500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf03071640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0ad580 con 0x7fbefc089a40 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf03071640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0ace10 con 0x7fbefc06b580 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf03071640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0b1d90 con 0x7fbefc0890c0 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbefc089a40 0x7fbefc15ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35254/0 (socket says 172.21.15.167:35254) 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 -- 172.21.15.167:0/2054888588 learned_addr learned my addr 172.21.15.167:0/2054888588 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0186e640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc0890c0 0x7fbefc089500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177169639 0 0) 0x7fbefc0ad580 con 0x7fbefc089a40 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee8003530 con 0x7fbefc089a40 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460589901 0 0) 0x7fbee8003530 con 0x7fbefc089a40 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc0890c0 msgr2=0x7fbefc089500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc0890c0 0x7fbefc089500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 >> v1:172.21.15.190:6789/0 conn(0x7fbefc06b580 legacy=0x7fbefc0ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc06b960 con 0x7fbefc089a40 2024-09-13T17:21:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fbef4001a20 con 0x7fbefc089a40 2024-09-13T17:21:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 >> v1:172.21.15.167:6789/0 conn(0x7fbefc089a40 legacy=0x7fbefc15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee80039b0 0x7fbee8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee80047d0 0x7fbee8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbee8005190 0x7fbee800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0b1d90 con 0x7fbee80039b0 2024-09-13T17:21:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee800c030 con 0x7fbee80047d0 2024-09-13T17:21:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee800c1f0 con 0x7fbee8005190 2024-09-13T17:21:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbee8005190 0x7fbee800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0186e640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee80047d0 0x7fbee8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf0206f640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee80039b0 0x7fbee8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c2dffb640 1 -- 172.21.15.167:0/2720342317 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c38128070 con 0x7f9c3001bde0 2024-09-13T17:21:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c300e97c0 con 0x7f9c3001bde0 2024-09-13T17:21:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c2dffb640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9c1c066690 0x7f9c1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7f9c2dffb640 1 -- 172.21.15.167:0/2720342317 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c3818b2f0 con 0x7f9c3001bde0 2024-09-13T17:21:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7f9c3d653640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9c1c066690 0x7f9c1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf61b9640 1 Processor -- start 2024-09-13T17:21:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 -- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee80047d0 msgr2=0x7fbee8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee80047d0 0x7fbee8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 -- 172.21.15.167:0/2054888588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee80039b0 msgr2=0x7fbee8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee80039b0 0x7fbee8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.090+0000 7fbf02870640 1 -- 172.21.15.167:0/2054888588 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc06b960 con 0x7fbee8005190 2024-09-13T17:21:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf61b9640 1 -- start start 2024-09-13T17:21:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7f9c3d653640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9c1c066690 0x7f9c1c068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c28007fd0 tx=0x7f9c28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf61b9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcaf00adc70 0x7fcaf0099670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf61b9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcaf0142080 0x7fcaf01424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7faf6ad20640 1 Processor -- start 2024-09-13T17:21:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7faf6ad20640 1 -- start start 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fbf02870640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbee8005190 0x7fbee800b990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbef400f9d0 tx=0x7fbef4021600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b5c75dcb9219b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf49b6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcaf0142080 0x7fcaf01424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf49b6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcaf0142080 0x7fcaf01424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46018/0 (socket says 172.21.15.167:46018) 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf49b6640 1 -- 172.21.15.167:0/1662981807 learned_addr learned my addr 172.21.15.167:0/1662981807 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf00ac3e0 con 0x7fcaf0144fe0 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00ad2a0 con 0x7fcaf0142080 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00b2cd0 con 0x7fcaf00adc70 2024-09-13T17:21:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107139484 0 0) 0x7fcaf00ac3e0 con 0x7fcaf0144fe0 2024-09-13T17:21:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcadc003530 con 0x7fcaf0144fe0 2024-09-13T17:21:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40b0620 con 0x7fbee8005190 2024-09-13T17:21:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef40ac070 con 0x7fbee8005190 2024-09-13T17:21:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fbf0106d640 1 -- 172.21.15.167:0/2054888588 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40b09c0 con 0x7fbee8005190 2024-09-13T17:21:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fbf03071640 1 -- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbee8005190 msgr2=0x7fbee800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fbf03071640 1 --2- 172.21.15.167:0/2054888588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbee8005190 0x7fbee800b990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbef400f9d0 tx=0x7fbef4021600 comp rx=0 tx=0).stop 2024-09-13T17:21:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 -- 172.21.15.167:0/2054888588 reap_dead start 2024-09-13T17:21:18.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 86081533 0 0) 0x7fcadc003530 con 0x7fcaf0144fe0 2024-09-13T17:21:18.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 >> v2:172.21.15.190:3300/0 conn(0x7fcaf00adc70 msgr2=0x7fcaf0099670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:21:18.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 --2- 172.21.15.167:0/1662981807 >> v2:172.21.15.190:3300/0 conn(0x7fcaf00adc70 0x7fcaf0099670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 >> v2:172.21.15.167:3300/0 conn(0x7fcaf0142080 msgr2=0x7fcaf01424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 --2- 172.21.15.167:0/1662981807 >> v2:172.21.15.167:3300/0 conn(0x7fcaf0142080 0x7fcaf01424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf00ae050 con 0x7fcaf0144fe0 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fcae8001a00 con 0x7fcaf0144fe0 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 >> v1:172.21.15.190:6789/0 conn(0x7fcaf0144fe0 legacy=0x7fcaf01453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcadc003980 0x7fcadc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.094+0000 7fcae7fff640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcadc0047d0 0x7fcadc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcae7fff640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc005390 0x7fcadc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00ad2a0 con 0x7fcadc005390 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00b2cd0 con 0x7fcadc0047d0 2024-09-13T17:21:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc00c2d0 con 0x7fcadc003980 2024-09-13T17:21:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- 172.21.15.167:0/2054888588 shutdown_connections 2024-09-13T17:21:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- 172.21.15.167:0/2054888588 >> 172.21.15.167:0/2054888588 conn(0x7fbefc0b70f0 msgr2=0x7fbefc0b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- 172.21.15.167:0/2054888588 shutdown_connections 2024-09-13T17:21:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf49b6640 1 --2- 172.21.15.167:0/1662981807 >> v2:172.21.15.167:3300/0 conn(0x7fcaf0142080 0x7fcaf01424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf49b6640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcadc0047d0 0x7fcadc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf59b8640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc005390 0x7fcadc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf49b6640 1 -- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcadc003980 msgr2=0x7fcadc003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf49b6640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcadc003980 0x7fcadc003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf49b6640 1 -- 172.21.15.167:0/1662981807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc005390 msgr2=0x7fcadc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf49b6640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc005390 0x7fcadc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf49b6640 1 -- 172.21.15.167:0/1662981807 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc003530 con 0x7fcadc0047d0 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf59b8640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc005390 0x7fcadc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fcaf59b8640 1 -- 172.21.15.167:0/1662981807 reap_dead start 2024-09-13T17:21:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf6ad20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf640b43e0 0x7faf6406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf63fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7faf64144220 0x7faf641407d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35270/0 (socket says 172.21.15.167:35270) 2024-09-13T17:21:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf6ad20640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faf64140ee0 0x7faf6414e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf63fff640 1 -- 172.21.15.167:0/1609348447 learned_addr learned my addr 172.21.15.167:0/1609348447 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf692bd640 1 --2- 172.21.15.167:0/1609348447 >> v2:172.21.15.167:3300/0 conn(0x7faf64140ee0 0x7faf6414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- 172.21.15.167:0/2054888588 wait complete. 2024-09-13T17:21:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 Processor -- start 2024-09-13T17:21:18.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf64141340 con 0x7faf64144220 2024-09-13T17:21:18.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640b4c90 con 0x7faf64140ee0 2024-09-13T17:21:18.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6406dd40 con 0x7faf640b43e0 2024-09-13T17:21:18.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- start start 2024-09-13T17:21:18.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbefc09bfd0 0x7fbefc1ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc09c3b0 0x7fbefc070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc157790 0x7fbefc1fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc070350 con 0x7fbefc157790 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc06fdf0 con 0x7fbefc09bfd0 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf03071640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc1f6230 con 0x7fbefc09c3b0 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc157790 0x7fbefc1fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc157790 0x7fbefc1fbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46046/0 (socket says 172.21.15.167:46046) 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 -- 172.21.15.167:0/2312850541 learned_addr learned my addr 172.21.15.167:0/2312850541 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf0206f640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbefc09bfd0 0x7fbefc1ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf0186e640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc09c3b0 0x7fbefc070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 -- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc09c3b0 msgr2=0x7fbefc070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc09c3b0 0x7fbefc070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 -- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbefc09bfd0 msgr2=0x7fbefc1ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbefc09bfd0 0x7fbefc1ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 -- 172.21.15.167:0/2312850541 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc070070 con 0x7fbefc157790 2024-09-13T17:21:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf692bd640 1 -- 172.21.15.167:0/1609348447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf640b43e0 msgr2=0x7faf6406d590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:21:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf692bd640 1 --2- 172.21.15.167:0/1609348447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf640b43e0 0x7faf6406d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf692bd640 1 -- 172.21.15.167:0/1609348447 >> v1:172.21.15.167:6789/0 conn(0x7faf64144220 legacy=0x7faf641407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7faf692bd640 1 -- 172.21.15.167:0/1609348447 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6406dad0 con 0x7faf64140ee0 2024-09-13T17:21:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.098+0000 7fbf02870640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc157790 0x7fbefc1fbad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbef400fa00 tx=0x7fbee8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fcaf49b6640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcadc0047d0 0x7fcadc004c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcae000ab60 tx=0x7fcae001c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec77a413138eeb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f9c2dffb640 1 -- 172.21.15.167:0/2720342317 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c381584b0 con 0x7f9c3001bde0 2024-09-13T17:21:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00a95f0 con 0x7fcadc0047d0 2024-09-13T17:21:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae00a9750 con 0x7fcadc0047d0 2024-09-13T17:21:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fcae7fff640 1 -- 172.21.15.167:0/1662981807 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00a9b00 con 0x7fcadc0047d0 2024-09-13T17:21:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fbef2ffd640 1 -- 172.21.15.167:0/2312850541 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4004b70 con 0x7fbefc157790 2024-09-13T17:21:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fbef2ffd640 1 -- 172.21.15.167:0/2312850541 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4004cd0 con 0x7fbefc157790 2024-09-13T17:21:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fbef2ffd640 1 -- 172.21.15.167:0/2312850541 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40ba6b0 con 0x7fbefc157790 2024-09-13T17:21:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcadc0047d0 msgr2=0x7fcadc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcadc0047d0 0x7fcadc004c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcae000ab60 tx=0x7fcae001c710 comp rx=0 tx=0).stop 2024-09-13T17:21:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7faf692bd640 1 --2- 172.21.15.167:0/1609348447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf64140ee0 0x7faf6414e120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009d90 tx=0x7faf5c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4b9e1209c143ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7faf637fe640 1 -- 172.21.15.167:0/1609348447 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0a5990 con 0x7faf64140ee0 2024-09-13T17:21:18.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7faf637fe640 1 -- 172.21.15.167:0/1609348447 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0a5af0 con 0x7faf64140ee0 2024-09-13T17:21:18.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7faf637fe640 1 -- 172.21.15.167:0/1609348447 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0a5e80 con 0x7faf64140ee0 2024-09-13T17:21:18.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc09cd90 con 0x7fbefc157790 2024-09-13T17:21:18.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc0706c0 con 0x7fbefc157790 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26bc019640 1 Processor -- start 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26bc019640 1 -- start start 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26bc019640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26b40acb40 0x7f26b4099190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26bc019640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f26b40b2570 0x7f26b41547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26bc019640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b40ac0e0 con 0x7f26b40996d0 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26bc019640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b406b1b0 con 0x7f26b40acb40 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26bc019640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b40ae030 con 0x7f26b40b2570 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26b9db5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26b40acb40 0x7f26b4099190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26ba5b6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f26b40b2570 0x7f26b41547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26b9db5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26b40acb40 0x7f26b4099190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46062/0 (socket says 172.21.15.167:46062) 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26b9db5640 1 -- 172.21.15.167:0/2764915619 learned_addr learned my addr 172.21.15.167:0/2764915619 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26b9db5640 1 -- 172.21.15.167:0/2764915619 >> v2:172.21.15.190:3300/0 conn(0x7f26b40b2570 msgr2=0x7f26b41547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26b9db5640 1 --2- 172.21.15.167:0/2764915619 >> v2:172.21.15.190:3300/0 conn(0x7f26b40b2570 0x7f26b41547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26b9db5640 1 -- 172.21.15.167:0/2764915619 >> v1:172.21.15.190:6789/0 conn(0x7f26b40996d0 legacy=0x7f26b40b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.102+0000 7f26b9db5640 1 -- 172.21.15.167:0/2764915619 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b40ad390 con 0x7f26b40acb40 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf64140ee0 msgr2=0x7faf6414e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 --2- 172.21.15.167:0/1609348447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf64140ee0 0x7faf6414e120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009d90 tx=0x7faf5c01c8d0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc0708d0 con 0x7fbefc157790 2024-09-13T17:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 shutdown_connections 2024-09-13T17:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/1662981807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcadc0047d0 0x7fcadc004c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 >> 172.21.15.167:0/1662981807 conn(0x7fcaf00b3a20 msgr2=0x7fcaf00b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 shutdown_connections 2024-09-13T17:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- 172.21.15.167:0/1662981807 wait complete. 2024-09-13T17:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 Processor -- start 2024-09-13T17:21:18.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 shutdown_connections 2024-09-13T17:21:18.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 --2- 172.21.15.167:0/1609348447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf64140ee0 0x7faf6414e120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 --2- 172.21.15.167:0/1609348447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf640b43e0 0x7faf6406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 >> 172.21.15.167:0/1609348447 conn(0x7faf6409b150 msgr2=0x7faf6409b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 shutdown_connections 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- start start 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc0047d0 0x7fcaf00b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaf01da690 0x7fcaf0070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaf006fbe0 0x7fcaf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00714b0 con 0x7fcadc0047d0 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01da200 con 0x7fcaf01da690 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf61b9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf011fcc0 con 0x7fcaf006fbe0 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7fcaf59b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaf006fbe0 0x7fcaf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaf006fbe0 0x7fcaf006e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.167:36864/0 (socket says 172.21.15.167:36864) 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 -- 172.21.15.167:0/558011545 learned_addr learned my addr 172.21.15.167:0/558011545 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf49b6640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaf01da690 0x7fcaf0070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.106+0000 7faf6ad20640 1 -- 172.21.15.167:0/1609348447 wait complete. 2024-09-13T17:21:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 Processor -- start 2024-09-13T17:21:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 -- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaf01da690 msgr2=0x7fcaf0070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaf01da690 0x7fcaf0070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 -- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc0047d0 msgr2=0x7fcaf00b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc0047d0 0x7fcaf00b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 -- 172.21.15.167:0/558011545 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf01d9bb0 con 0x7fcaf006fbe0 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf59b8640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaf006fbe0 0x7fcaf006e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcae8002240 tx=0x7fcae8011c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcae5ffb640 1 -- 172.21.15.167:0/558011545 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8003b90 con 0x7fcaf006fbe0 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcae5ffb640 1 -- 172.21.15.167:0/558011545 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8003cf0 con 0x7fcaf006fbe0 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcae5ffb640 1 -- 172.21.15.167:0/558011545 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80052f0 con 0x7fcaf006fbe0 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 -- start start 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640b43e0 0x7faf6414d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf64140ee0 0x7faf641e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf64144220 0x7faf6406b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6409f240 con 0x7faf640b43e0 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6406cf50 con 0x7faf64144220 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640b3030 con 0x7faf64140ee0 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf64140ee0 0x7faf641e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf692bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf64144220 0x7faf6406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf64140ee0 0x7faf641e5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.167:36876/0 (socket says 172.21.15.167:36876) 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 -- 172.21.15.167:0/2610869280 learned_addr learned my addr 172.21.15.167:0/2610869280 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 -- 172.21.15.167:0/2610869280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf64144220 msgr2=0x7faf6406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf64144220 0x7faf6406b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 -- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640b43e0 msgr2=0x7faf6414d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640b43e0 0x7faf6414d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 -- 172.21.15.167:0/2610869280 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009a70 con 0x7faf64140ee0 2024-09-13T17:21:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf01d9e90 con 0x7fcaf006fbe0 2024-09-13T17:21:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf00b10d0 con 0x7fcaf006fbe0 2024-09-13T17:21:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf63fff640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf64140ee0 0x7faf641e5440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf5000c400 tx=0x7faf5000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf617fa640 1 -- 172.21.15.167:0/2610869280 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50005cf0 con 0x7faf64140ee0 2024-09-13T17:21:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6409ead0 con 0x7faf64140ee0 2024-09-13T17:21:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6409f450 con 0x7faf64140ee0 2024-09-13T17:21:18.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf617fa640 1 -- 172.21.15.167:0/2610869280 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50005e50 con 0x7faf64140ee0 2024-09-13T17:21:18.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.110+0000 7faf617fa640 1 -- 172.21.15.167:0/2610869280 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500072d0 con 0x7faf64140ee0 2024-09-13T17:21:18.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf44005260 con 0x7faf64140ee0 2024-09-13T17:21:18.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7f26b9db5640 1 --2- 172.21.15.167:0/2764915619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b4099190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f26b4122ef0 tx=0x7f26b001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7628fec7226279 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fbef2ffd640 1 -- 172.21.15.167:0/2312850541 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbef40b7070 con 0x7fbefc157790 2024-09-13T17:21:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fbef2ffd640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbee0066690 0x7fbee0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fbef2ffd640 1 -- 172.21.15.167:0/2312850541 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbef411dbd0 con 0x7fbefc157790 2024-09-13T17:21:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7faf617fa640 1 -- 172.21.15.167:0/2610869280 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf50007430 con 0x7faf64140ee0 2024-09-13T17:21:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7faf617fa640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf48066690 0x7faf48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7faf617fa640 1 -- 172.21.15.167:0/2610869280 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf50083f50 con 0x7faf64140ee0 2024-09-13T17:21:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7faf68abc640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf48066690 0x7faf48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fcae5ffb640 1 -- 172.21.15.167:0/558011545 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcae8005450 con 0x7fcaf006fbe0 2024-09-13T17:21:18.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fcae5ffb640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcad40666c0 0x7fcad4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fcae5ffb640 1 -- 172.21.15.167:0/558011545 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcae8087400 con 0x7fcaf006fbe0 2024-09-13T17:21:18.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fbf0206f640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbee0066690 0x7fbee0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fcaf51b7640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcad40666c0 0x7fcad4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fcaf51b7640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcad40666c0 0x7fcad4068b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0067520 tx=0x7fcaec006c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7fbf0206f640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbee0066690 0x7fbee0068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbef8007fd0 tx=0x7fbef8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.114+0000 7faf68abc640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf48066690 0x7faf48068b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf6414dc80 tx=0x7faf58006c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf01d9a10 con 0x7fcaf006fbe0 2024-09-13T17:21:18.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7fbef2ffd640 1 -- 172.21.15.167:0/2312850541 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbefc0708d0 con 0x7fbefc157790 2024-09-13T17:21:18.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f628995b640 1 Processor -- start 2024-09-13T17:21:18.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f628995b640 1 -- start start 2024-09-13T17:21:18.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26b8db3640 1 -- 172.21.15.167:0/2764915619 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00ab600 con 0x7f26b40acb40 2024-09-13T17:21:18.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26b8db3640 1 -- 172.21.15.167:0/2764915619 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00a7050 con 0x7f26b40acb40 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 -- 172.21.15.167:0/2764915619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 msgr2=0x7f26b4099190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 --2- 172.21.15.167:0/2764915619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b4099190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f26b4122ef0 tx=0x7f26b001c3d0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 -- 172.21.15.167:0/2764915619 shutdown_connections 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 --2- 172.21.15.167:0/2764915619 >> v2:172.21.15.190:3300/0 conn(0x7f26b40b2570 0x7f26b41547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 --2- 172.21.15.167:0/2764915619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b4099190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 -- 172.21.15.167:0/2764915619 >> 172.21.15.167:0/2764915619 conn(0x7f26b406a660 msgr2=0x7f26b40b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 -- 172.21.15.167:0/2764915619 shutdown_connections 2024-09-13T17:21:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.118+0000 7f26bc019640 1 -- 172.21.15.167:0/2764915619 wait complete. 2024-09-13T17:21:18.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f628995b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f628406d7f0 0x7f62841471f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f628995b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62840b50e0 0x7f6284147730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f628995b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840b48e0 con 0x7f628414a360 2024-09-13T17:21:18.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f628995b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840b4680 con 0x7f62840b50e0 2024-09-13T17:21:18.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f628995b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840b5610 con 0x7f628406d7f0 2024-09-13T17:21:18.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 Processor -- start 2024-09-13T17:21:18.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f62837fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f628414a360 0x7f628414a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.167:49112/0 (socket says 172.21.15.167:49112) 2024-09-13T17:21:18.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f62837fe640 1 -- 172.21.15.167:0/3064299205 learned_addr learned my addr 172.21.15.167:0/3064299205 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:18.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f62827fc640 1 --2- 172.21.15.167:0/3064299205 >> v2:172.21.15.167:3300/0 conn(0x7f62840b50e0 0x7f6284147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 -- start start 2024-09-13T17:21:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26b40996d0 0x7f26b40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26b40b2570 0x7f26b406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4070060 con 0x7f26b40acb40 2024-09-13T17:21:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40b14c0 con 0x7f26b40b2570 2024-09-13T17:21:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40b1250 con 0x7f26b40996d0 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26ba5b6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26b40b2570 0x7f26b406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b40b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46106/0 (socket says 172.21.15.167:46106) 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 -- 172.21.15.167:0/3870828327 learned_addr learned my addr 172.21.15.167:0/3870828327 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 -- 172.21.15.167:0/3870828327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26b40996d0 msgr2=0x7f26b40ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26b40996d0 0x7f26b40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 -- 172.21.15.167:0/3870828327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26b40b2570 msgr2=0x7f26b406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26b40b2570 0x7f26b406e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 -- 172.21.15.167:0/3870828327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b00094d0 con 0x7f26b40acb40 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26ba5b6640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26b40b2570 0x7f26b406e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26b95b4640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b40b0950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c3d0 tx=0x7f26a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26aa7fc640 1 -- 172.21.15.167:0/3870828327 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40052d0 con 0x7f26b40acb40 2024-09-13T17:21:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b4141550 con 0x7f26b40acb40 2024-09-13T17:21:18.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b4070260 con 0x7f26b40acb40 2024-09-13T17:21:18.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f26aa7fc640 1 -- 172.21.15.167:0/3870828327 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4005430 con 0x7f26b40acb40 2024-09-13T17:21:18.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f62827fc640 1 -- 172.21.15.167:0/3064299205 >> v2:172.21.15.190:3300/0 conn(0x7f628406d7f0 msgr2=0x7f62841471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f62827fc640 1 --2- 172.21.15.167:0/3064299205 >> v2:172.21.15.190:3300/0 conn(0x7f628406d7f0 0x7f62841471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f62827fc640 1 -- 172.21.15.167:0/3064299205 >> v1:172.21.15.190:6789/0 conn(0x7f628414a360 legacy=0x7f628414a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.122+0000 7f62827fc640 1 -- 172.21.15.167:0/3064299205 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284149e60 con 0x7f62840b50e0 2024-09-13T17:21:18.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f62827fc640 1 --2- 172.21.15.167:0/3064299205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62840b50e0 0x7f6284147730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f628409bd30 tx=0x7f627801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e905ee35682b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f26aa7fc640 1 -- 172.21.15.167:0/3870828327 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4003820 con 0x7f26b40acb40 2024-09-13T17:21:18.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7faf617fa640 1 -- 172.21.15.167:0/2610869280 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf500510f0 con 0x7faf64140ee0 2024-09-13T17:21:18.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f61e13c9640 1 Processor -- start 2024-09-13T17:21:18.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f61e13c9640 1 -- start start 2024-09-13T17:21:18.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f6281ffb640 1 -- 172.21.15.167:0/3064299205 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780ab5f0 con 0x7f62840b50e0 2024-09-13T17:21:18.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f6281ffb640 1 -- 172.21.15.167:0/3064299205 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62780ab750 con 0x7f62840b50e0 2024-09-13T17:21:18.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f6281ffb640 1 -- 172.21.15.167:0/3064299205 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780abae0 con 0x7f62840b50e0 2024-09-13T17:21:18.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c005260 con 0x7f26b40acb40 2024-09-13T17:21:18.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f26aa7fc640 1 -- 172.21.15.167:0/3870828327 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26a4003980 con 0x7f26b40acb40 2024-09-13T17:21:18.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f61e13c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61dc071f10 0x7f61dc140880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61e13c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61e13c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc071bb0 con 0x7f61dc0717d0 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61e13c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc141300 con 0x7f61dc071f10 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61e13c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0723a0 con 0x7f61dc09ac70 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61daffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f61dc0717d0 0x7f61dc0b5e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.167:49126/0 (socket says 172.21.15.167:49126) 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61daffd640 1 -- 172.21.15.167:0/899853889 learned_addr learned my addr 172.21.15.167:0/899853889 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61db7fe640 1 --2- 172.21.15.167:0/899853889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61db7fe640 1 -- 172.21.15.167:0/899853889 >> v2:172.21.15.167:3300/0 conn(0x7f61dc071f10 msgr2=0x7f61dc140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61db7fe640 1 --2- 172.21.15.167:0/899853889 >> v2:172.21.15.167:3300/0 conn(0x7f61dc071f10 0x7f61dc140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61db7fe640 1 -- 172.21.15.167:0/899853889 >> v1:172.21.15.190:6789/0 conn(0x7f61dc0717d0 legacy=0x7f61dc0b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61db7fe640 1 -- 172.21.15.167:0/899853889 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc070740 con 0x7f61dc09ac70 2024-09-13T17:21:18.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f61db7fe640 1 --2- 172.21.15.167:0/899853889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc140dc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009d90 tx=0x7f61d401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6baa807ddf0b551b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.126+0000 7f26aa7fc640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2698066690 0x7f2698068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f26aa7fc640 1 -- 172.21.15.167:0/3870828327 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26a4083930 con 0x7f26b40acb40 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f628995b640 1 -- 172.21.15.167:0/3064299205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62840b50e0 msgr2=0x7f6284147730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f628995b640 1 --2- 172.21.15.167:0/3064299205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62840b50e0 0x7f6284147730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f628409bd30 tx=0x7f627801c410 comp rx=0 tx=0).stop 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f628995b640 1 -- 172.21.15.167:0/3064299205 shutdown_connections 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f628995b640 1 --2- 172.21.15.167:0/3064299205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62840b50e0 0x7f6284147730 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f628409bd30 tx=0x7f627801c410 comp rx=0 tx=0).stop 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f628995b640 1 --2- 172.21.15.167:0/3064299205 >> v2:172.21.15.190:3300/0 conn(0x7f628406d7f0 0x7f62841471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.130+0000 7f628995b640 1 -- 172.21.15.167:0/3064299205 >> 172.21.15.167:0/3064299205 conn(0x7f628409b150 msgr2=0x7f628409b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.134+0000 7f628995b640 1 -- 172.21.15.167:0/3064299205 shutdown_connections 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.134+0000 7f628995b640 1 -- 172.21.15.167:0/3064299205 wait complete. 2024-09-13T17:21:18.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.134+0000 7f26b9db5640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2698066690 0x7f2698068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.134+0000 7f26b9db5640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2698066690 0x7f2698068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f26b00ad000 tx=0x7f26b0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.134+0000 7f628995b640 1 Processor -- start 2024-09-13T17:21:18.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f26aa7fc640 1 -- 172.21.15.167:0/3870828327 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26a40509d0 con 0x7f26b40acb40 2024-09-13T17:21:18.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f628995b640 1 -- start start 2024-09-13T17:21:18.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f628995b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f628406d7f0 0x7f62840b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f628995b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f628414a360 0x7f62840b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f628995b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62840b23d0 0x7f62840b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f628995b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628409e5c0 con 0x7f628406d7f0 2024-09-13T17:21:18.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f628995b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628409cf50 con 0x7f628414a360 2024-09-13T17:21:18.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f628995b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628409e250 con 0x7f62840b23d0 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f628406d7f0 0x7f62840b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f628406d7f0 0x7f62840b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46128/0 (socket says 172.21.15.167:46128) 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 -- 172.21.15.167:0/1207695929 learned_addr learned my addr 172.21.15.167:0/1207695929 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f62827fc640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f628414a360 0x7f62840b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f62837fe640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62840b23d0 0x7f62840b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 -- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62840b23d0 msgr2=0x7f62840b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62840b23d0 0x7f62840b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 -- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f628414a360 msgr2=0x7f62840b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f628414a360 0x7f62840b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 -- 172.21.15.167:0/1207695929 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009420 con 0x7f628406d7f0 2024-09-13T17:21:18.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f61d9ffb640 1 -- 172.21.15.167:0/899853889 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40a5a10 con 0x7f61dc09ac70 2024-09-13T17:21:18.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f61d9ffb640 1 -- 172.21.15.167:0/899853889 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d40a5b70 con 0x7f61dc09ac70 2024-09-13T17:21:18.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f61d9ffb640 1 -- 172.21.15.167:0/899853889 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40ad440 con 0x7f61dc09ac70 2024-09-13T17:21:18.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f6282ffd640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f628406d7f0 0x7f62840b7cf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f627400b580 tx=0x7f627400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7fcae5ffb640 1 -- 172.21.15.167:0/558011545 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcaf01d9a10 con 0x7fcaf006fbe0 2024-09-13T17:21:18.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f61e13c9640 1 -- 172.21.15.167:0/899853889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 msgr2=0x7f61dc140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f61e13c9640 1 --2- 172.21.15.167:0/899853889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc140dc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009d90 tx=0x7f61d401c990 comp rx=0 tx=0).stop 2024-09-13T17:21:18.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f626bfff640 1 -- 172.21.15.167:0/1207695929 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274010870 con 0x7f628406d7f0 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.138+0000 7f626bfff640 1 -- 172.21.15.167:0/1207695929 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740109f0 con 0x7f628406d7f0 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.142+0000 7f626bfff640 1 -- 172.21.15.167:0/1207695929 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274010da0 con 0x7f628406d7f0 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.142+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62840b3f20 con 0x7f628406d7f0 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.142+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628409d780 con 0x7f628406d7f0 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.142+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628414a7f0 con 0x7f628406d7f0 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.142+0000 7f626bfff640 1 -- 172.21.15.167:0/1207695929 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f627400f3c0 con 0x7f628406d7f0 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.142+0000 7f626bfff640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f62700666e0 0x7f6270068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.150+0000 7f626bfff640 1 -- 172.21.15.167:0/1207695929 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6274084390 con 0x7f628406d7f0 2024-09-13T17:21:18.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.150+0000 7f62827fc640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f62700666e0 0x7f6270068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.150+0000 7f62827fc640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f62700666e0 0x7f6270068ba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62780af000 tx=0x7f62780a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.154+0000 7f626bfff640 1 -- 172.21.15.167:0/1207695929 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6274051530 con 0x7f628406d7f0 2024-09-13T17:21:18.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- 172.21.15.167:0/899853889 shutdown_connections 2024-09-13T17:21:18.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 --2- 172.21.15.167:0/899853889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc140dc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 --2- 172.21.15.167:0/899853889 >> v2:172.21.15.167:3300/0 conn(0x7f61dc071f10 0x7f61dc140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- 172.21.15.167:0/899853889 >> 172.21.15.167:0/899853889 conn(0x7f61dc0b9570 msgr2=0x7f61dc0b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- 172.21.15.167:0/899853889 shutdown_connections 2024-09-13T17:21:18.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- 172.21.15.167:0/899853889 wait complete. 2024-09-13T17:21:18.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 Processor -- start 2024-09-13T17:21:18.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- start start 2024-09-13T17:21:18.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61dc0717d0 0x7f61dc1ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61dc0af600 0x7f61dc0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc142990 con 0x7f61dc0af600 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc143e60 con 0x7f61dc0717d0 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61e13c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1eeb30 con 0x7f61dc09ac70 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61db7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61dc0af600 0x7f61dc0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61db7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61dc0af600 0x7f61dc0afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46136/0 (socket says 172.21.15.167:46136) 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61db7fe640 1 -- 172.21.15.167:0/2561232320 learned_addr learned my addr 172.21.15.167:0/2561232320 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61da7fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.162+0000 7f61daffd640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61dc0717d0 0x7f61dc1ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.166+0000 7f61db7fe640 1 -- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 msgr2=0x7f61dc141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.166+0000 7f61db7fe640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.166+0000 7f61db7fe640 1 -- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61dc0717d0 msgr2=0x7f61dc1ee490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.166+0000 7f61db7fe640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61dc0717d0 0x7f61dc1ee490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.166+0000 7f61db7fe640 1 -- 172.21.15.167:0/2561232320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4009a70 con 0x7f61dc0af600 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.166+0000 7f61daffd640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61dc0717d0 0x7f61dc1ee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:18.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.166+0000 7f61db7fe640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61dc0af600 0x7f61dc0afab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61d401b040 tx=0x7f61d4019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.170+0000 7f61c37fe640 1 -- 172.21.15.167:0/2561232320 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40a5a10 con 0x7f61dc0af600 2024-09-13T17:21:18.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.170+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc09e990 con 0x7f61dc0af600 2024-09-13T17:21:18.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.170+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc0b04d0 con 0x7f61dc0af600 2024-09-13T17:21:18.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.170+0000 7f61c37fe640 1 -- 172.21.15.167:0/2561232320 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4009450 con 0x7f61dc0af600 2024-09-13T17:21:18.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.170+0000 7f61c37fe640 1 -- 172.21.15.167:0/2561232320 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40c2650 con 0x7f61dc0af600 2024-09-13T17:21:18.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.170+0000 7f61c37fe640 1 -- 172.21.15.167:0/2561232320 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61d40b4050 con 0x7f61dc0af600 2024-09-13T17:21:18.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.170+0000 7f61c37fe640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f61c8066690 0x7f61c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.174+0000 7f61c37fe640 1 -- 172.21.15.167:0/2561232320 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61d40f07f0 con 0x7f61dc0af600 2024-09-13T17:21:18.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.174+0000 7f61daffd640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f61c8066690 0x7f61c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.174+0000 7f61daffd640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f61c8066690 0x7f61c8068b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f61cc005890 tx=0x7f61cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.178+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc005260 con 0x7f61dc0af600 2024-09-13T17:21:18.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.186+0000 7f61c37fe640 1 -- 172.21.15.167:0/2561232320 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61d40c7080 con 0x7f61dc0af600 2024-09-13T17:21:18.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.378+0000 7f2617e6a640 1 -- 172.21.15.167:0/1191295967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2610145d30 con 0x7f261006b410 2024-09-13T17:21:18.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.378+0000 7f26067fc640 1 -- 172.21.15.167:0/1191295967 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f260c054e20 con 0x7f261006b410 2024-09-13T17:21:18.384 INFO:teuthology.orchestra.run.smithi167.stdout:55834574860 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 -- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25f4066790 msgr2=0x7f25f4068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25f4066790 0x7f25f4068c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26080ae000 tx=0x7f2608007040 comp rx=0 tx=0).stop 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 -- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f261006b410 msgr2=0x7f2610070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f261006b410 0x7f2610070d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f260c00ea00 tx=0x7f260c00eec0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 -- 172.21.15.167:0/1191295967 shutdown_connections 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25f4066790 0x7f25f4068c50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26100993b0 0x7f2610146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2610098a40 0x7f2610147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 --2- 172.21.15.167:0/1191295967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f261006b410 0x7f2610070d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 -- 172.21.15.167:0/1191295967 >> 172.21.15.167:0/1191295967 conn(0x7f261006a660 msgr2=0x7f26100b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 -- 172.21.15.167:0/1191295967 shutdown_connections 2024-09-13T17:21:18.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.382+0000 7f25f3fff640 1 -- 172.21.15.167:0/1191295967 wait complete. 2024-09-13T17:21:18.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.2 2024-09-13T17:21:18.408 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.406+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9c300e88d0 con 0x7f9c3001bde0 2024-09-13T17:21:18.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.406+0000 7f9c2dffb640 1 -- 172.21.15.167:0/2720342317 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c3815bad0 con 0x7f9c3001bde0 2024-09-13T17:21:18.409 INFO:teuthology.orchestra.run.smithi167.stdout:64424509449 2024-09-13T17:21:18.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9c1c066690 msgr2=0x7f9c1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9c1c066690 0x7f9c1c068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c28007fd0 tx=0x7f9c28009040 comp rx=0 tx=0).stop 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 msgr2=0x7f9c301827c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c301827c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c38066da0 tx=0x7f9c38086510 comp rx=0 tx=0).stop 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 shutdown_connections 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9c1c066690 0x7f9c1c068b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3001bde0 0x7f9c301827c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c3001b3a0 0x7f9c30182280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 --2- 172.21.15.167:0/2720342317 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c30009bf0 0x7f9c300e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 >> 172.21.15.167:0/2720342317 conn(0x7f9c30008e70 msgr2=0x7f9c3001db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 shutdown_connections 2024-09-13T17:21:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.410+0000 7f9c3e655640 1 -- 172.21.15.167:0/2720342317 wait complete. 2024-09-13T17:21:18.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-13T17:21:18.434 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.434+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbefc0708d0 con 0x7fbefc157790 2024-09-13T17:21:18.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbef2ffd640 1 -- 172.21.15.167:0/2312850541 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbefc0708d0 con 0x7fbefc157790 2024-09-13T17:21:18.439 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2024-09-13T17:21:18.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbee0066690 msgr2=0x7fbee0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbee0066690 0x7fbee0068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbef8007fd0 tx=0x7fbef8009040 comp rx=0 tx=0).stop 2024-09-13T17:21:18.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc157790 msgr2=0x7fbefc1fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc157790 0x7fbefc1fbad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbef400fa00 tx=0x7fbee8005800 comp rx=0 tx=0).stop 2024-09-13T17:21:18.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 shutdown_connections 2024-09-13T17:21:18.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fbee0066690 0x7fbee0068b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc157790 0x7fbefc1fbad0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbefc09c3b0 0x7fbefc070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 --2- 172.21.15.167:0/2312850541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbefc09bfd0 0x7fbefc1ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 >> 172.21.15.167:0/2312850541 conn(0x7fbefc0b70f0 msgr2=0x7fbefc0aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.438+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 shutdown_connections 2024-09-13T17:21:18.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.442+0000 7fbf03071640 1 -- 172.21.15.167:0/2312850541 wait complete. 2024-09-13T17:21:18.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.442+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faf440057e0 con 0x7faf64140ee0 2024-09-13T17:21:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf617fa640 1 -- 172.21.15.167:0/2610869280 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf50021020 con 0x7faf64140ee0 2024-09-13T17:21:18.447 INFO:teuthology.orchestra.run.smithi167.stdout:64424509449 2024-09-13T17:21:18.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf48066690 msgr2=0x7faf48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf48066690 0x7faf48068b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf6414dc80 tx=0x7faf58006c50 comp rx=0 tx=0).stop 2024-09-13T17:21:18.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf64140ee0 msgr2=0x7faf641e5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf64140ee0 0x7faf641e5440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf5000c400 tx=0x7faf5000c8c0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 shutdown_connections 2024-09-13T17:21:18.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7faf48066690 0x7faf48068b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf64144220 0x7faf6406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf64140ee0 0x7faf641e5440 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 --2- 172.21.15.167:0/2610869280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640b43e0 0x7faf6414d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 >> 172.21.15.167:0/2610869280 conn(0x7faf6409b150 msgr2=0x7faf6413f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 shutdown_connections 2024-09-13T17:21:18.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.446+0000 7faf6ad20640 1 -- 172.21.15.167:0/2610869280 wait complete. 2024-09-13T17:21:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.454+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61bc0050d0 con 0x7f61dc0af600 2024-09-13T17:21:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.454+0000 7f61c37fe640 1 -- 172.21.15.167:0/2561232320 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61d40b2020 con 0x7f61dc0af600 2024-09-13T17:21:18.457 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2024-09-13T17:21:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.454+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcaf01d9a10 con 0x7fcaf006fbe0 2024-09-13T17:21:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.454+0000 7fcae5ffb640 1 -- 172.21.15.167:0/558011545 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcaf01d9a10 con 0x7fcaf006fbe0 2024-09-13T17:21:18.458 INFO:teuthology.orchestra.run.smithi167.stdout:64424509449 2024-09-13T17:21:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f61c8066690 msgr2=0x7f61c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f61c8066690 0x7f61c8068b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f61cc005890 tx=0x7f61cc009040 comp rx=0 tx=0).stop 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61dc0af600 msgr2=0x7f61dc0afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61dc0af600 0x7f61dc0afab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61d401b040 tx=0x7f61d4019730 comp rx=0 tx=0).stop 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 shutdown_connections 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f61c8066690 0x7f61c8068b50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61dc0af600 0x7f61dc0afab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f61dc09ac70 0x7f61dc141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 --2- 172.21.15.167:0/2561232320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61dc0717d0 0x7f61dc1ee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 >> 172.21.15.167:0/2561232320 conn(0x7f61dc0b9570 msgr2=0x7f61dc09b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 shutdown_connections 2024-09-13T17:21:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f61e13c9640 1 -- 172.21.15.167:0/2561232320 wait complete. 2024-09-13T17:21:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f269c005510 con 0x7f26b40acb40 2024-09-13T17:21:18.461 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2024-09-13T17:21:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.458+0000 7f26aa7fc640 1 -- 172.21.15.167:0/3870828327 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26a4053ff0 con 0x7f26b40acb40 2024-09-13T17:21:18.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcad40666c0 msgr2=0x7fcad4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcad40666c0 0x7fcad4068b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0067520 tx=0x7fcaec006c50 comp rx=0 tx=0).stop 2024-09-13T17:21:18.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaf006fbe0 msgr2=0x7fcaf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaf006fbe0 0x7fcaf006e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcae8002240 tx=0x7fcae8011c80 comp rx=0 tx=0).stop 2024-09-13T17:21:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2698066690 msgr2=0x7f2698068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2698066690 0x7f2698068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f26b00ad000 tx=0x7f26b0004740 comp rx=0 tx=0).stop 2024-09-13T17:21:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 msgr2=0x7f26b40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b40b0950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c3d0 tx=0x7f26a400c890 comp rx=0 tx=0).stop 2024-09-13T17:21:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 shutdown_connections 2024-09-13T17:21:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fcad40666c0 0x7fcad4068b80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaf006fbe0 0x7fcaf006e2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaf01da690 0x7fcaf0070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 --2- 172.21.15.167:0/558011545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcadc0047d0 0x7fcaf00b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 >> 172.21.15.167:0/558011545 conn(0x7fcaf00b3a20 msgr2=0x7fcaf01437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 shutdown_connections 2024-09-13T17:21:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 shutdown_connections 2024-09-13T17:21:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2698066690 0x7f2698068b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26b40b2570 0x7f26b406e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40acb40 0x7f26b40b0950 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 --2- 172.21.15.167:0/3870828327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26b40996d0 0x7f26b40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 >> 172.21.15.167:0/3870828327 conn(0x7f26b406a660 msgr2=0x7f26b414c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7fcaf61b9640 1 -- 172.21.15.167:0/558011545 wait complete. 2024-09-13T17:21:18.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 shutdown_connections 2024-09-13T17:21:18.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.462+0000 7f26bc019640 1 -- 172.21.15.167:0/3870828327 wait complete. 2024-09-13T17:21:18.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-09-13T17:21:18.471 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6284145620 con 0x7f628406d7f0 2024-09-13T17:21:18.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f626bfff640 1 -- 172.21.15.167:0/1207695929 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6274054b50 con 0x7f628406d7f0 2024-09-13T17:21:18.472 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2024-09-13T17:21:18.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-09-13T17:21:18.475 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f62700666e0 msgr2=0x7f6270068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f62700666e0 0x7f6270068ba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62780af000 tx=0x7f62780a7000 comp rx=0 tx=0).stop 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f628406d7f0 msgr2=0x7f62840b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f628406d7f0 0x7f62840b7cf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f627400b580 tx=0x7f627400ba40 comp rx=0 tx=0).stop 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 shutdown_connections 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f62700666e0 0x7f6270068ba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62840b23d0 0x7f62840b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f628414a360 0x7f62840b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 --2- 172.21.15.167:0/1207695929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f628406d7f0 0x7f62840b7cf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 >> 172.21.15.167:0/1207695929 conn(0x7f628409b150 msgr2=0x7f6284149170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 shutdown_connections 2024-09-13T17:21:18.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.470+0000 7f628995b640 1 -- 172.21.15.167:0/1207695929 wait complete. 2024-09-13T17:21:18.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-09-13T17:21:18.487 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.0 2024-09-13T17:21:18.490 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-09-13T17:21:18.490 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-09-13T17:21:18.497 DEBUG:teuthology.parallel:result is None 2024-09-13T17:21:18.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:21:18.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:21:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.638+0000 7f298a3c5640 1 Processor -- start 2024-09-13T17:21:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.638+0000 7f298a3c5640 1 -- start start 2024-09-13T17:21:18.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29840b0960 0x7f298413d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f298413ddf0 0x7f298414e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2984071b10 con 0x7f298406f0f0 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298406f7f0 con 0x7f29840b0960 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29840712c0 con 0x7f298413ddf0 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f29837fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29840b0960 0x7f298413d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f2983fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f298406f0f0 0x7f2984070bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35274/0 (socket says 172.21.15.167:35274) 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f2983fff640 1 -- 172.21.15.167:0/3428001083 learned_addr learned my addr 172.21.15.167:0/3428001083 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f2988962640 1 --2- 172.21.15.167:0/3428001083 >> v2:172.21.15.190:3300/0 conn(0x7f298413ddf0 0x7f298414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f29837fe640 1 -- 172.21.15.167:0/3428001083 >> v2:172.21.15.190:3300/0 conn(0x7f298413ddf0 msgr2=0x7f298414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f29837fe640 1 --2- 172.21.15.167:0/3428001083 >> v2:172.21.15.190:3300/0 conn(0x7f298413ddf0 0x7f298414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f29837fe640 1 -- 172.21.15.167:0/3428001083 >> v1:172.21.15.167:6789/0 conn(0x7f298406f0f0 legacy=0x7f2984070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f29837fe640 1 -- 172.21.15.167:0/3428001083 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984071df0 con 0x7f29840b0960 2024-09-13T17:21:18.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f29837fe640 1 --2- 172.21.15.167:0/3428001083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413d8b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f298406bca0 tx=0x7f297801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9113e0ed1c0685c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f2982ffd640 1 -- 172.21.15.167:0/3428001083 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29780ad660 con 0x7f29840b0960 2024-09-13T17:21:18.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f2982ffd640 1 -- 172.21.15.167:0/3428001083 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29780ad7c0 con 0x7f29840b0960 2024-09-13T17:21:18.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f2982ffd640 1 -- 172.21.15.167:0/3428001083 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29780adb50 con 0x7f29840b0960 2024-09-13T17:21:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- 172.21.15.167:0/3428001083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 msgr2=0x7f298413d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3428001083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413d8b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f298406bca0 tx=0x7f297801c360 comp rx=0 tx=0).stop 2024-09-13T17:21:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- 172.21.15.167:0/3428001083 shutdown_connections 2024-09-13T17:21:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3428001083 >> v2:172.21.15.190:3300/0 conn(0x7f298413ddf0 0x7f298414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3428001083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413d8b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- 172.21.15.167:0/3428001083 >> 172.21.15.167:0/3428001083 conn(0x7f29840b7250 msgr2=0x7f29840b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- 172.21.15.167:0/3428001083 shutdown_connections 2024-09-13T17:21:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.642+0000 7f298a3c5640 1 -- 172.21.15.167:0/3428001083 wait complete. 2024-09-13T17:21:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 Processor -- start 2024-09-13T17:21:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 -- start start 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f298406f0f0 0x7f29840aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f298413ddf0 0x7f29841dedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29840a79c0 con 0x7f29840b0960 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29840a8a00 con 0x7f298413ddf0 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298413a170 con 0x7f298406f0f0 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46168/0 (socket says 172.21.15.167:46168) 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 -- 172.21.15.167:0/3379487089 learned_addr learned my addr 172.21.15.167:0/3379487089 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f2988962640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f298413ddf0 0x7f29841dedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f2983fff640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f298406f0f0 0x7f29840aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 -- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f298406f0f0 msgr2=0x7f29840aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f298406f0f0 0x7f29840aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 -- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f298413ddf0 msgr2=0x7f29841dedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f298413ddf0 0x7f29841dedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 -- 172.21.15.167:0/3379487089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978009420 con 0x7f29840b0960 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f29837fe640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413ff90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29780b0040 tx=0x7f297801aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f2980ff9640 1 -- 172.21.15.167:0/3379487089 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29780b9860 con 0x7f29840b0960 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f2980ff9640 1 -- 172.21.15.167:0/3379487089 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29780b99c0 con 0x7f29840b0960 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f2980ff9640 1 -- 172.21.15.167:0/3379487089 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29780b9d50 con 0x7f29840b0960 2024-09-13T17:21:18.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29840a7c10 con 0x7f29840b0960 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29841df310 con 0x7f29840b0960 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298413d8b0 con 0x7f29840b0960 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.646+0000 7f2980ff9640 1 -- 172.21.15.167:0/3379487089 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29780b7400 con 0x7f29840b0960 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.650+0000 7f2980ff9640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2970066690 0x7f2970068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.650+0000 7f2980ff9640 1 -- 172.21.15.167:0/3379487089 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f297811f2a0 con 0x7f29840b0960 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.650+0000 7f2983fff640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2970066690 0x7f2970068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.650+0000 7f2983fff640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2970066690 0x7f2970068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2974005890 tx=0x7f2974007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.654+0000 7f2980ff9640 1 -- 172.21.15.167:0/3379487089 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29780ec4d0 con 0x7f29840b0960 2024-09-13T17:21:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.794+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29840b0da0 con 0x7f2970066690 2024-09-13T17:21:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.806+0000 7f2980ff9640 1 -- 172.21.15.167:0/3379487089 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345225 (secure 0 0 0) 0x7f2974014040 con 0x7f2970066690 2024-09-13T17:21:18.811 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:18.813 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:21:18.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2970066690 msgr2=0x7f2970068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2970066690 0x7f2970068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2974005890 tx=0x7f2974007cf0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 msgr2=0x7f298413ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413ff90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29780b0040 tx=0x7f297801aba0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 shutdown_connections 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2970066690 0x7f2970068b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f298413ddf0 0x7f29841dedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29840b0960 0x7f298413ff90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 --2- 172.21.15.167:0/3379487089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f298406f0f0 0x7f29840aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 >> 172.21.15.167:0/3379487089 conn(0x7f29840b7250 msgr2=0x7f298413bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 shutdown_connections 2024-09-13T17:21:18.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.810+0000 7f298a3c5640 1 -- 172.21.15.167:0/3379487089 wait complete. 2024-09-13T17:21:18.828 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-13T17:21:17.501343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2070506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004892"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978674+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:20:54.978674+0000","last_peered":"2024-09-13T17:20:54.978674+0000","last_clean":"2024-09-13T17:20:54.978674+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:20:54.978674+0000","last_undegraded":"2024-09-13T17:20:54.978674+0000","last_fullsized":"2024-09-13T17:20:54.978674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964650+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:20:54.964650+0000","last_peered":"2024-09-13T17:20:54.964650+0000","last_clean":"2024-09-13T17:20:54.964650+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:20:54.964650+0000","last_undegraded":"2024-09-13T17:20:54.964650+0000","last_fullsized":"2024-09-13T17:20:54.964650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364375+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:20:56.364375+0000","last_peered":"2024-09-13T17:20:56.364375+0000","last_clean":"2024-09-13T17:20:56.364375+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:20:56.364375+0000","last_undegraded":"2024-09-13T17:20:56.364375+0000","last_fullsized":"2024-09-13T17:20:56.364375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964867+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:20:54.964867+0000","last_peered":"2024-09-13T17:20:54.964867+0000","last_clean":"2024-09-13T17:20:54.964867+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:20:54.964867+0000","last_undegraded":"2024-09-13T17:20:54.964867+0000","last_fullsized":"2024-09-13T17:20:54.964867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978333+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:20:54.978333+0000","last_peered":"2024-09-13T17:20:54.978333+0000","last_clean":"2024-09-13T17:20:54.978333+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:20:54.978333+0000","last_undegraded":"2024-09-13T17:20:54.978333+0000","last_fullsized":"2024-09-13T17:20:54.978333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319629+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:20:56.319629+0000","last_peered":"2024-09-13T17:20:56.319629+0000","last_clean":"2024-09-13T17:20:56.319629+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:20:56.319629+0000","last_undegraded":"2024-09-13T17:20:56.319629+0000","last_fullsized":"2024-09-13T17:20:56.319629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196854+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:20:55.196854+0000","last_peered":"2024-09-13T17:20:55.196854+0000","last_clean":"2024-09-13T17:20:55.196854+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:20:55.196854+0000","last_undegraded":"2024-09-13T17:20:55.196854+0000","last_fullsized":"2024-09-13T17:20:55.196854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973231+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:20:54.973231+0000","last_peered":"2024-09-13T17:20:54.973231+0000","last_clean":"2024-09-13T17:20:54.973231+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:20:54.973231+0000","last_undegraded":"2024-09-13T17:20:54.973231+0000","last_fullsized":"2024-09-13T17:20:54.973231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320003+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:20:56.320003+0000","last_peered":"2024-09-13T17:20:56.320003+0000","last_clean":"2024-09-13T17:20:56.320003+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:20:56.320003+0000","last_undegraded":"2024-09-13T17:20:56.320003+0000","last_fullsized":"2024-09-13T17:20:56.320003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195592+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:20:55.195592+0000","last_peered":"2024-09-13T17:20:55.195592+0000","last_clean":"2024-09-13T17:20:55.195592+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:20:55.195592+0000","last_undegraded":"2024-09-13T17:20:55.195592+0000","last_fullsized":"2024-09-13T17:20:55.195592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973550+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:20:54.973550+0000","last_peered":"2024-09-13T17:20:54.973550+0000","last_clean":"2024-09-13T17:20:54.973550+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:20:54.973550+0000","last_undegraded":"2024-09-13T17:20:54.973550+0000","last_fullsized":"2024-09-13T17:20:54.973550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319861+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:20:56.319861+0000","last_peered":"2024-09-13T17:20:56.319861+0000","last_clean":"2024-09-13T17:20:56.319861+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:20:56.319861+0000","last_undegraded":"2024-09-13T17:20:56.319861+0000","last_fullsized":"2024-09-13T17:20:56.319861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971678+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:20:54.971678+0000","last_peered":"2024-09-13T17:20:54.971678+0000","last_clean":"2024-09-13T17:20:54.971678+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:20:54.971678+0000","last_undegraded":"2024-09-13T17:20:54.971678+0000","last_fullsized":"2024-09-13T17:20:54.971678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195771+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:20:55.195771+0000","last_peered":"2024-09-13T17:20:55.195771+0000","last_clean":"2024-09-13T17:20:55.195771+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:20:55.195771+0000","last_undegraded":"2024-09-13T17:20:55.195771+0000","last_fullsized":"2024-09-13T17:20:55.195771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.321065+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:20:56.321065+0000","last_peered":"2024-09-13T17:20:56.321065+0000","last_clean":"2024-09-13T17:20:56.321065+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:20:56.321065+0000","last_undegraded":"2024-09-13T17:20:56.321065+0000","last_fullsized":"2024-09-13T17:20:56.321065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961879+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:20:54.961879+0000","last_peered":"2024-09-13T17:20:54.961879+0000","last_clean":"2024-09-13T17:20:54.961879+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:20:54.961879+0000","last_undegraded":"2024-09-13T17:20:54.961879+0000","last_fullsized":"2024-09-13T17:20:54.961879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979253+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:20:54.979253+0000","last_peered":"2024-09-13T17:20:54.979253+0000","last_clean":"2024-09-13T17:20:54.979253+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:20:54.979253+0000","last_undegraded":"2024-09-13T17:20:54.979253+0000","last_fullsized":"2024-09-13T17:20:54.979253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320528+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:20:56.320528+0000","last_peered":"2024-09-13T17:20:56.320528+0000","last_clean":"2024-09-13T17:20:56.320528+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:20:56.320528+0000","last_undegraded":"2024-09-13T17:20:56.320528+0000","last_fullsized":"2024-09-13T17:20:56.320528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964725+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:20:54.964725+0000","last_peered":"2024-09-13T17:20:54.964725+0000","last_clean":"2024-09-13T17:20:54.964725+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:20:54.964725+0000","last_undegraded":"2024-09-13T17:20:54.964725+0000","last_fullsized":"2024-09-13T17:20:54.964725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978739+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:20:54.978739+0000","last_peered":"2024-09-13T17:20:54.978739+0000","last_clean":"2024-09-13T17:20:54.978739+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:20:54.978739+0000","last_undegraded":"2024-09-13T17:20:54.978739+0000","last_fullsized":"2024-09-13T17:20:54.978739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357122+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:20:55.357122+0000","last_peered":"2024-09-13T17:20:55.357122+0000","last_clean":"2024-09-13T17:20:55.357122+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:20:55.357122+0000","last_undegraded":"2024-09-13T17:20:55.357122+0000","last_fullsized":"2024-09-13T17:20:55.357122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978042+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:20:54.978042+0000","last_peered":"2024-09-13T17:20:54.978042+0000","last_clean":"2024-09-13T17:20:54.978042+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:20:54.978042+0000","last_undegraded":"2024-09-13T17:20:54.978042+0000","last_fullsized":"2024-09-13T17:20:54.978042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185338+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:20:55.185338+0000","last_peered":"2024-09-13T17:20:55.185338+0000","last_clean":"2024-09-13T17:20:55.185338+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:20:55.185338+0000","last_undegraded":"2024-09-13T17:20:55.185338+0000","last_fullsized":"2024-09-13T17:20:55.185338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320965+0000","last_change":"2024-09-13T17:20:55.001193+0000","last_active":"2024-09-13T17:20:56.320965+0000","last_peered":"2024-09-13T17:20:56.320965+0000","last_clean":"2024-09-13T17:20:56.320965+0000","last_became_active":"2024-09-13T17:20:54.999414+0000","last_became_peered":"2024-09-13T17:20:54.999414+0000","last_unstale":"2024-09-13T17:20:56.320965+0000","last_undegraded":"2024-09-13T17:20:56.320965+0000","last_fullsized":"2024-09-13T17:20:56.320965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978390+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:20:54.978390+0000","last_peered":"2024-09-13T17:20:54.978390+0000","last_clean":"2024-09-13T17:20:54.978390+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:20:54.978390+0000","last_undegraded":"2024-09-13T17:20:54.978390+0000","last_fullsized":"2024-09-13T17:20:54.978390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.974170+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:20:54.974170+0000","last_peered":"2024-09-13T17:20:54.974170+0000","last_clean":"2024-09-13T17:20:54.974170+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:20:54.974170+0000","last_undegraded":"2024-09-13T17:20:54.974170+0000","last_fullsized":"2024-09-13T17:20:54.974170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319977+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:20:56.319977+0000","last_peered":"2024-09-13T17:20:56.319977+0000","last_clean":"2024-09-13T17:20:56.319977+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:20:56.319977+0000","last_undegraded":"2024-09-13T17:20:56.319977+0000","last_fullsized":"2024-09-13T17:20:56.319977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964608+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:20:54.964608+0000","last_peered":"2024-09-13T17:20:54.964608+0000","last_clean":"2024-09-13T17:20:54.964608+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:20:54.964608+0000","last_undegraded":"2024-09-13T17:20:54.964608+0000","last_fullsized":"2024-09-13T17:20:54.964608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980238+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:20:54.980238+0000","last_peered":"2024-09-13T17:20:54.980238+0000","last_clean":"2024-09-13T17:20:54.980238+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:20:54.980238+0000","last_undegraded":"2024-09-13T17:20:54.980238+0000","last_fullsized":"2024-09-13T17:20:54.980238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363397+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:20:56.363397+0000","last_peered":"2024-09-13T17:20:56.363397+0000","last_clean":"2024-09-13T17:20:56.363397+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:20:56.363397+0000","last_undegraded":"2024-09-13T17:20:56.363397+0000","last_fullsized":"2024-09-13T17:20:56.363397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980577+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:20:54.980577+0000","last_peered":"2024-09-13T17:20:54.980577+0000","last_clean":"2024-09-13T17:20:54.980577+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:20:54.980577+0000","last_undegraded":"2024-09-13T17:20:54.980577+0000","last_fullsized":"2024-09-13T17:20:54.980577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197302+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:20:55.197302+0000","last_peered":"2024-09-13T17:20:55.197302+0000","last_clean":"2024-09-13T17:20:55.197302+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:20:55.197302+0000","last_undegraded":"2024-09-13T17:20:55.197302+0000","last_fullsized":"2024-09-13T17:20:55.197302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363358+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:20:56.363358+0000","last_peered":"2024-09-13T17:20:56.363358+0000","last_clean":"2024-09-13T17:20:56.363358+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:20:56.363358+0000","last_undegraded":"2024-09-13T17:20:56.363358+0000","last_fullsized":"2024-09-13T17:20:56.363358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973762+0000","last_change":"2024-09-13T17:20:50.971732+0000","last_active":"2024-09-13T17:20:54.973762+0000","last_peered":"2024-09-13T17:20:54.973762+0000","last_clean":"2024-09-13T17:20:54.973762+0000","last_became_active":"2024-09-13T17:20:50.964584+0000","last_became_peered":"2024-09-13T17:20:50.964584+0000","last_unstale":"2024-09-13T17:20:54.973762+0000","last_undegraded":"2024-09-13T17:20:54.973762+0000","last_fullsized":"2024-09-13T17:20:54.973762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980696+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:20:54.980696+0000","last_peered":"2024-09-13T17:20:54.980696+0000","last_clean":"2024-09-13T17:20:54.980696+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:20:54.980696+0000","last_undegraded":"2024-09-13T17:20:54.980696+0000","last_fullsized":"2024-09-13T17:20:54.980696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356150+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:20:55.356150+0000","last_peered":"2024-09-13T17:20:55.356150+0000","last_clean":"2024-09-13T17:20:55.356150+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:20:55.356150+0000","last_undegraded":"2024-09-13T17:20:55.356150+0000","last_fullsized":"2024-09-13T17:20:55.356150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.988158+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:20:54.988158+0000","last_peered":"2024-09-13T17:20:54.988158+0000","last_clean":"2024-09-13T17:20:54.988158+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:20:54.988158+0000","last_undegraded":"2024-09-13T17:20:54.988158+0000","last_fullsized":"2024-09-13T17:20:54.988158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971489+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:20:54.971489+0000","last_peered":"2024-09-13T17:20:54.971489+0000","last_clean":"2024-09-13T17:20:54.971489+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:20:54.971489+0000","last_undegraded":"2024-09-13T17:20:54.971489+0000","last_fullsized":"2024-09-13T17:20:54.971489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356971+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:20:55.356971+0000","last_peered":"2024-09-13T17:20:55.356971+0000","last_clean":"2024-09-13T17:20:55.356971+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:20:55.356971+0000","last_undegraded":"2024-09-13T17:20:55.356971+0000","last_fullsized":"2024-09-13T17:20:55.356971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979502+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:20:54.979502+0000","last_peered":"2024-09-13T17:20:54.979502+0000","last_clean":"2024-09-13T17:20:54.979502+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:20:54.979502+0000","last_undegraded":"2024-09-13T17:20:54.979502+0000","last_fullsized":"2024-09-13T17:20:54.979502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958088+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:20:54.958088+0000","last_peered":"2024-09-13T17:20:54.958088+0000","last_clean":"2024-09-13T17:20:54.958088+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:20:54.958088+0000","last_undegraded":"2024-09-13T17:20:54.958088+0000","last_fullsized":"2024-09-13T17:20:54.958088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:09.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357445+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:20:55.357445+0000","last_peered":"2024-09-13T17:20:55.357445+0000","last_clean":"2024-09-13T17:20:55.357445+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:20:55.357445+0000","last_undegraded":"2024-09-13T17:20:55.357445+0000","last_fullsized":"2024-09-13T17:20:55.357445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977867+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:20:54.977867+0000","last_peered":"2024-09-13T17:20:54.977867+0000","last_clean":"2024-09-13T17:20:54.977867+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:20:54.977867+0000","last_undegraded":"2024-09-13T17:20:54.977867+0000","last_fullsized":"2024-09-13T17:20:54.977867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185295+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:20:55.185295+0000","last_peered":"2024-09-13T17:20:55.185295+0000","last_clean":"2024-09-13T17:20:55.185295+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:20:55.185295+0000","last_undegraded":"2024-09-13T17:20:55.185295+0000","last_fullsized":"2024-09-13T17:20:55.185295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363798+0000","last_change":"2024-09-13T17:20:55.185849+0000","last_active":"2024-09-13T17:20:56.363798+0000","last_peered":"2024-09-13T17:20:56.363798+0000","last_clean":"2024-09-13T17:20:56.363798+0000","last_became_active":"2024-09-13T17:20:55.185460+0000","last_became_peered":"2024-09-13T17:20:55.185460+0000","last_unstale":"2024-09-13T17:20:56.363798+0000","last_undegraded":"2024-09-13T17:20:56.363798+0000","last_fullsized":"2024-09-13T17:20:56.363798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961006+0000","last_change":"2024-09-13T17:20:50.969430+0000","last_active":"2024-09-13T17:20:54.961006+0000","last_peered":"2024-09-13T17:20:54.961006+0000","last_clean":"2024-09-13T17:20:54.961006+0000","last_became_active":"2024-09-13T17:20:50.969161+0000","last_became_peered":"2024-09-13T17:20:50.969161+0000","last_unstale":"2024-09-13T17:20:54.961006+0000","last_undegraded":"2024-09-13T17:20:54.961006+0000","last_fullsized":"2024-09-13T17:20:54.961006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.972323+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:20:54.972323+0000","last_peered":"2024-09-13T17:20:54.972323+0000","last_clean":"2024-09-13T17:20:54.972323+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:20:54.972323+0000","last_undegraded":"2024-09-13T17:20:54.972323+0000","last_fullsized":"2024-09-13T17:20:54.972323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185441+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:20:55.185441+0000","last_peered":"2024-09-13T17:20:55.185441+0000","last_clean":"2024-09-13T17:20:55.185441+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:20:55.185441+0000","last_undegraded":"2024-09-13T17:20:55.185441+0000","last_fullsized":"2024-09-13T17:20:55.185441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361982+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:20:55.361982+0000","last_peered":"2024-09-13T17:20:55.361982+0000","last_clean":"2024-09-13T17:20:55.361982+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:20:55.361982+0000","last_undegraded":"2024-09-13T17:20:55.361982+0000","last_fullsized":"2024-09-13T17:20:55.361982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196583+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:20:55.196583+0000","last_peered":"2024-09-13T17:20:55.196583+0000","last_clean":"2024-09-13T17:20:55.196583+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:20:55.196583+0000","last_undegraded":"2024-09-13T17:20:55.196583+0000","last_fullsized":"2024-09-13T17:20:55.196583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958622+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:20:54.958622+0000","last_peered":"2024-09-13T17:20:54.958622+0000","last_clean":"2024-09-13T17:20:54.958622+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:20:54.958622+0000","last_undegraded":"2024-09-13T17:20:54.958622+0000","last_fullsized":"2024-09-13T17:20:54.958622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361044+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:20:55.361044+0000","last_peered":"2024-09-13T17:20:55.361044+0000","last_clean":"2024-09-13T17:20:55.361044+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:20:55.361044+0000","last_undegraded":"2024-09-13T17:20:55.361044+0000","last_fullsized":"2024-09-13T17:20:55.361044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973440+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:20:54.973440+0000","last_peered":"2024-09-13T17:20:54.973440+0000","last_clean":"2024-09-13T17:20:54.973440+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:20:54.973440+0000","last_undegraded":"2024-09-13T17:20:54.973440+0000","last_fullsized":"2024-09-13T17:20:54.973440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980090+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:20:54.980090+0000","last_peered":"2024-09-13T17:20:54.980090+0000","last_clean":"2024-09-13T17:20:54.980090+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:20:54.980090+0000","last_undegraded":"2024-09-13T17:20:54.980090+0000","last_fullsized":"2024-09-13T17:20:54.980090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363528+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:20:56.363528+0000","last_peered":"2024-09-13T17:20:56.363528+0000","last_clean":"2024-09-13T17:20:56.363528+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:20:56.363528+0000","last_undegraded":"2024-09-13T17:20:56.363528+0000","last_fullsized":"2024-09-13T17:20:56.363528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197060+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:20:55.197060+0000","last_peered":"2024-09-13T17:20:55.197060+0000","last_clean":"2024-09-13T17:20:55.197060+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:20:55.197060+0000","last_undegraded":"2024-09-13T17:20:55.197060+0000","last_fullsized":"2024-09-13T17:20:55.197060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958535+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:20:54.958535+0000","last_peered":"2024-09-13T17:20:54.958535+0000","last_clean":"2024-09-13T17:20:54.958535+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:20:54.958535+0000","last_undegraded":"2024-09-13T17:20:54.958535+0000","last_fullsized":"2024-09-13T17:20:54.958535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:33.533450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.326297+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:20:56.326297+0000","last_peered":"2024-09-13T17:20:56.326297+0000","last_clean":"2024-09-13T17:20:56.326297+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:20:56.326297+0000","last_undegraded":"2024-09-13T17:20:56.326297+0000","last_fullsized":"2024-09-13T17:20:56.326297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196551+0000","last_change":"2024-09-13T17:20:50.999071+0000","last_active":"2024-09-13T17:20:55.196551+0000","last_peered":"2024-09-13T17:20:55.196551+0000","last_clean":"2024-09-13T17:20:55.196551+0000","last_became_active":"2024-09-13T17:20:50.998444+0000","last_became_peered":"2024-09-13T17:20:50.998444+0000","last_unstale":"2024-09-13T17:20:55.196551+0000","last_undegraded":"2024-09-13T17:20:55.196551+0000","last_fullsized":"2024-09-13T17:20:55.196551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967211+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:20:54.967211+0000","last_peered":"2024-09-13T17:20:54.967211+0000","last_clean":"2024-09-13T17:20:54.967211+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:20:54.967211+0000","last_undegraded":"2024-09-13T17:20:54.967211+0000","last_fullsized":"2024-09-13T17:20:54.967211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319624+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:20:56.319624+0000","last_peered":"2024-09-13T17:20:56.319624+0000","last_clean":"2024-09-13T17:20:56.319624+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:20:56.319624+0000","last_undegraded":"2024-09-13T17:20:56.319624+0000","last_fullsized":"2024-09-13T17:20:56.319624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187527+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:20:55.187527+0000","last_peered":"2024-09-13T17:20:55.187527+0000","last_clean":"2024-09-13T17:20:55.187527+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:20:55.187527+0000","last_undegraded":"2024-09-13T17:20:55.187527+0000","last_fullsized":"2024-09-13T17:20:55.187527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957804+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:20:54.957804+0000","last_peered":"2024-09-13T17:20:54.957804+0000","last_clean":"2024-09-13T17:20:54.957804+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:20:54.957804+0000","last_undegraded":"2024-09-13T17:20:54.957804+0000","last_fullsized":"2024-09-13T17:20:54.957804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:25.139372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363726+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:20:56.363726+0000","last_peered":"2024-09-13T17:20:56.363726+0000","last_clean":"2024-09-13T17:20:56.363726+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:20:56.363726+0000","last_undegraded":"2024-09-13T17:20:56.363726+0000","last_fullsized":"2024-09-13T17:20:56.363726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969429+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:20:54.969429+0000","last_peered":"2024-09-13T17:20:54.969429+0000","last_clean":"2024-09-13T17:20:54.969429+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:20:54.969429+0000","last_undegraded":"2024-09-13T17:20:54.969429+0000","last_fullsized":"2024-09-13T17:20:54.969429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.968862+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:20:54.968862+0000","last_peered":"2024-09-13T17:20:54.968862+0000","last_clean":"2024-09-13T17:20:54.968862+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:20:54.968862+0000","last_undegraded":"2024-09-13T17:20:54.968862+0000","last_fullsized":"2024-09-13T17:20:54.968862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364693+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:20:56.364693+0000","last_peered":"2024-09-13T17:20:56.364693+0000","last_clean":"2024-09-13T17:20:56.364693+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:20:56.364693+0000","last_undegraded":"2024-09-13T17:20:56.364693+0000","last_fullsized":"2024-09-13T17:20:56.364693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.194492+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:20:55.194492+0000","last_peered":"2024-09-13T17:20:55.194492+0000","last_clean":"2024-09-13T17:20:55.194492+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:20:55.194492+0000","last_undegraded":"2024-09-13T17:20:55.194492+0000","last_fullsized":"2024-09-13T17:20:55.194492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969703+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:20:54.969703+0000","last_peered":"2024-09-13T17:20:54.969703+0000","last_clean":"2024-09-13T17:20:54.969703+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:20:54.969703+0000","last_undegraded":"2024-09-13T17:20:54.969703+0000","last_fullsized":"2024-09-13T17:20:54.969703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364409+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:20:56.364409+0000","last_peered":"2024-09-13T17:20:56.364409+0000","last_clean":"2024-09-13T17:20:56.364409+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:20:56.364409+0000","last_undegraded":"2024-09-13T17:20:56.364409+0000","last_fullsized":"2024-09-13T17:20:56.364409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980016+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:20:54.980016+0000","last_peered":"2024-09-13T17:20:54.980016+0000","last_clean":"2024-09-13T17:20:54.980016+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:20:54.980016+0000","last_undegraded":"2024-09-13T17:20:54.980016+0000","last_fullsized":"2024-09-13T17:20:54.980016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978568+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:20:54.978568+0000","last_peered":"2024-09-13T17:20:54.978568+0000","last_clean":"2024-09-13T17:20:54.978568+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:20:54.978568+0000","last_undegraded":"2024-09-13T17:20:54.978568+0000","last_fullsized":"2024-09-13T17:20:54.978568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.327970+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:20:56.327970+0000","last_peered":"2024-09-13T17:20:56.327970+0000","last_clean":"2024-09-13T17:20:56.327970+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:20:56.327970+0000","last_undegraded":"2024-09-13T17:20:56.327970+0000","last_fullsized":"2024-09-13T17:20:56.327970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196325+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:20:55.196325+0000","last_peered":"2024-09-13T17:20:55.196325+0000","last_clean":"2024-09-13T17:20:55.196325+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:20:55.196325+0000","last_undegraded":"2024-09-13T17:20:55.196325+0000","last_fullsized":"2024-09-13T17:20:55.196325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:21:00.906533+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:21:00.906533+0000","last_peered":"2024-09-13T17:21:00.906533+0000","last_clean":"2024-09-13T17:21:00.906533+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:21:00.906533+0000","last_undegraded":"2024-09-13T17:21:00.906533+0000","last_fullsized":"2024-09-13T17:21:00.906533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356271+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:20:55.356271+0000","last_peered":"2024-09-13T17:20:55.356271+0000","last_clean":"2024-09-13T17:20:55.356271+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:20:55.356271+0000","last_undegraded":"2024-09-13T17:20:55.356271+0000","last_fullsized":"2024-09-13T17:20:55.356271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977964+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:20:54.977964+0000","last_peered":"2024-09-13T17:20:54.977964+0000","last_clean":"2024-09-13T17:20:54.977964+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:20:54.977964+0000","last_undegraded":"2024-09-13T17:20:54.977964+0000","last_fullsized":"2024-09-13T17:20:54.977964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979963+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:20:54.979963+0000","last_peered":"2024-09-13T17:20:54.979963+0000","last_clean":"2024-09-13T17:20:54.979963+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:20:54.979963+0000","last_undegraded":"2024-09-13T17:20:54.979963+0000","last_fullsized":"2024-09-13T17:20:54.979963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320279+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:20:56.320279+0000","last_peered":"2024-09-13T17:20:56.320279+0000","last_clean":"2024-09-13T17:20:56.320279+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:20:56.320279+0000","last_undegraded":"2024-09-13T17:20:56.320279+0000","last_fullsized":"2024-09-13T17:20:56.320279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978448+0000","last_change":"2024-09-13T17:20:50.950985+0000","last_active":"2024-09-13T17:20:54.978448+0000","last_peered":"2024-09-13T17:20:54.978448+0000","last_clean":"2024-09-13T17:20:54.978448+0000","last_became_active":"2024-09-13T17:20:50.950732+0000","last_became_peered":"2024-09-13T17:20:50.950732+0000","last_unstale":"2024-09-13T17:20:54.978448+0000","last_undegraded":"2024-09-13T17:20:54.978448+0000","last_fullsized":"2024-09-13T17:20:54.978448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:20.173904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975473+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:20:54.975473+0000","last_peered":"2024-09-13T17:20:54.975473+0000","last_clean":"2024-09-13T17:20:54.975473+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:20:54.975473+0000","last_undegraded":"2024-09-13T17:20:54.975473+0000","last_fullsized":"2024-09-13T17:20:54.975473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363687+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:20:56.363687+0000","last_peered":"2024-09-13T17:20:56.363687+0000","last_clean":"2024-09-13T17:20:56.363687+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:20:56.363687+0000","last_undegraded":"2024-09-13T17:20:56.363687+0000","last_fullsized":"2024-09-13T17:20:56.363687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975343+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:20:54.975343+0000","last_peered":"2024-09-13T17:20:54.975343+0000","last_clean":"2024-09-13T17:20:54.975343+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:20:54.975343+0000","last_undegraded":"2024-09-13T17:20:54.975343+0000","last_fullsized":"2024-09-13T17:20:54.975343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973950+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:20:54.973950+0000","last_peered":"2024-09-13T17:20:54.973950+0000","last_clean":"2024-09-13T17:20:54.973950+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:20:54.973950+0000","last_undegraded":"2024-09-13T17:20:54.973950+0000","last_fullsized":"2024-09-13T17:20:54.973950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364471+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:20:56.364471+0000","last_peered":"2024-09-13T17:20:56.364471+0000","last_clean":"2024-09-13T17:20:56.364471+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:20:56.364471+0000","last_undegraded":"2024-09-13T17:20:56.364471+0000","last_fullsized":"2024-09-13T17:20:56.364471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363677+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:20:56.363677+0000","last_peered":"2024-09-13T17:20:56.363677+0000","last_clean":"2024-09-13T17:20:56.363677+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:20:56.363677+0000","last_undegraded":"2024-09-13T17:20:56.363677+0000","last_fullsized":"2024-09-13T17:20:56.363677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978733+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:20:54.978733+0000","last_peered":"2024-09-13T17:20:54.978733+0000","last_clean":"2024-09-13T17:20:54.978733+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:20:54.978733+0000","last_undegraded":"2024-09-13T17:20:54.978733+0000","last_fullsized":"2024-09-13T17:20:54.978733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970268+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:20:54.970268+0000","last_peered":"2024-09-13T17:20:54.970268+0000","last_clean":"2024-09-13T17:20:54.970268+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:20:54.970268+0000","last_undegraded":"2024-09-13T17:20:54.970268+0000","last_fullsized":"2024-09-13T17:20:54.970268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.362338+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:20:55.362338+0000","last_peered":"2024-09-13T17:20:55.362338+0000","last_clean":"2024-09-13T17:20:55.362338+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:20:55.362338+0000","last_undegraded":"2024-09-13T17:20:55.362338+0000","last_fullsized":"2024-09-13T17:20:55.362338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964603+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:20:54.964603+0000","last_peered":"2024-09-13T17:20:54.964603+0000","last_clean":"2024-09-13T17:20:54.964603+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:20:54.964603+0000","last_undegraded":"2024-09-13T17:20:54.964603+0000","last_fullsized":"2024-09-13T17:20:54.964603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.965450+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:20:54.965450+0000","last_peered":"2024-09-13T17:20:54.965450+0000","last_clean":"2024-09-13T17:20:54.965450+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:20:54.965450+0000","last_undegraded":"2024-09-13T17:20:54.965450+0000","last_fullsized":"2024-09-13T17:20:54.965450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971921+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:20:54.971921+0000","last_peered":"2024-09-13T17:20:54.971921+0000","last_clean":"2024-09-13T17:20:54.971921+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:20:54.971921+0000","last_undegraded":"2024-09-13T17:20:54.971921+0000","last_fullsized":"2024-09-13T17:20:54.971921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978472+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:20:54.978472+0000","last_peered":"2024-09-13T17:20:54.978472+0000","last_clean":"2024-09-13T17:20:54.978472+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:20:54.978472+0000","last_undegraded":"2024-09-13T17:20:54.978472+0000","last_fullsized":"2024-09-13T17:20:54.978472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363860+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:20:56.363860+0000","last_peered":"2024-09-13T17:20:56.363860+0000","last_clean":"2024-09-13T17:20:56.363860+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:20:56.363860+0000","last_undegraded":"2024-09-13T17:20:56.363860+0000","last_fullsized":"2024-09-13T17:20:56.363860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:31.608726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.962109+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:20:54.962109+0000","last_peered":"2024-09-13T17:20:54.962109+0000","last_clean":"2024-09-13T17:20:54.962109+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:20:54.962109+0000","last_undegraded":"2024-09-13T17:20:54.962109+0000","last_fullsized":"2024-09-13T17:20:54.962109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967803+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:20:54.967803+0000","last_peered":"2024-09-13T17:20:54.967803+0000","last_clean":"2024-09-13T17:20:54.967803+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:20:54.967803+0000","last_undegraded":"2024-09-13T17:20:54.967803+0000","last_fullsized":"2024-09-13T17:20:54.967803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364614+0000","last_change":"2024-09-13T17:20:55.004868+0000","last_active":"2024-09-13T17:20:56.364614+0000","last_peered":"2024-09-13T17:20:56.364614+0000","last_clean":"2024-09-13T17:20:56.364614+0000","last_became_active":"2024-09-13T17:20:55.004397+0000","last_became_peered":"2024-09-13T17:20:55.004397+0000","last_unstale":"2024-09-13T17:20:56.364614+0000","last_undegraded":"2024-09-13T17:20:56.364614+0000","last_fullsized":"2024-09-13T17:20:56.364614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:51.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969083+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:20:54.969083+0000","last_peered":"2024-09-13T17:20:54.969083+0000","last_clean":"2024-09-13T17:20:54.969083+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:20:54.969083+0000","last_undegraded":"2024-09-13T17:20:54.969083+0000","last_fullsized":"2024-09-13T17:20:54.969083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957932+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:20:54.957932+0000","last_peered":"2024-09-13T17:20:54.957932+0000","last_clean":"2024-09-13T17:20:54.957932+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:20:54.957932+0000","last_undegraded":"2024-09-13T17:20:54.957932+0000","last_fullsized":"2024-09-13T17:20:54.957932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:44.697368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969569+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:20:54.969569+0000","last_peered":"2024-09-13T17:20:54.969569+0000","last_clean":"2024-09-13T17:20:54.969569+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:20:54.969569+0000","last_undegraded":"2024-09-13T17:20:54.969569+0000","last_fullsized":"2024-09-13T17:20:54.969569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978286+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:20:54.978286+0000","last_peered":"2024-09-13T17:20:54.978286+0000","last_clean":"2024-09-13T17:20:54.978286+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:20:54.978286+0000","last_undegraded":"2024-09-13T17:20:54.978286+0000","last_fullsized":"2024-09-13T17:20:54.978286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966771+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:20:54.966771+0000","last_peered":"2024-09-13T17:20:54.966771+0000","last_clean":"2024-09-13T17:20:54.966771+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:20:54.966771+0000","last_undegraded":"2024-09-13T17:20:54.966771+0000","last_fullsized":"2024-09-13T17:20:54.966771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979791+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:20:54.979791+0000","last_peered":"2024-09-13T17:20:54.979791+0000","last_clean":"2024-09-13T17:20:54.979791+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:20:54.979791+0000","last_undegraded":"2024-09-13T17:20:54.979791+0000","last_fullsized":"2024-09-13T17:20:54.979791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969316+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:20:54.969316+0000","last_peered":"2024-09-13T17:20:54.969316+0000","last_clean":"2024-09-13T17:20:54.969316+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:20:54.969316+0000","last_undegraded":"2024-09-13T17:20:54.969316+0000","last_fullsized":"2024-09-13T17:20:54.969316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964475+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:20:54.964475+0000","last_peered":"2024-09-13T17:20:54.964475+0000","last_clean":"2024-09-13T17:20:54.964475+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:20:54.964475+0000","last_undegraded":"2024-09-13T17:20:54.964475+0000","last_fullsized":"2024-09-13T17:20:54.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970101+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:20:54.970101+0000","last_peered":"2024-09-13T17:20:54.970101+0000","last_clean":"2024-09-13T17:20:54.970101+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:20:54.970101+0000","last_undegraded":"2024-09-13T17:20:54.970101+0000","last_fullsized":"2024-09-13T17:20:54.970101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.963584+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:20:54.963584+0000","last_peered":"2024-09-13T17:20:54.963584+0000","last_clean":"2024-09-13T17:20:54.963584+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:20:54.963584+0000","last_undegraded":"2024-09-13T17:20:54.963584+0000","last_fullsized":"2024-09-13T17:20:54.963584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969472+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:20:54.969472+0000","last_peered":"2024-09-13T17:20:54.969472+0000","last_clean":"2024-09-13T17:20:54.969472+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:20:54.969472+0000","last_undegraded":"2024-09-13T17:20:54.969472+0000","last_fullsized":"2024-09-13T17:20:54.969472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978177+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:20:54.978177+0000","last_peered":"2024-09-13T17:20:54.978177+0000","last_clean":"2024-09-13T17:20:54.978177+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:20:54.978177+0000","last_undegraded":"2024-09-13T17:20:54.978177+0000","last_fullsized":"2024-09-13T17:20:54.978177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966978+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:20:54.966978+0000","last_peered":"2024-09-13T17:20:54.966978+0000","last_clean":"2024-09-13T17:20:54.966978+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:20:54.966978+0000","last_undegraded":"2024-09-13T17:20:54.966978+0000","last_fullsized":"2024-09-13T17:20:54.966978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197080+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:20:55.197080+0000","last_peered":"2024-09-13T17:20:55.197080+0000","last_clean":"2024-09-13T17:20:55.197080+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:20:55.197080+0000","last_undegraded":"2024-09-13T17:20:55.197080+0000","last_fullsized":"2024-09-13T17:20:55.197080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958011+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:20:54.958011+0000","last_peered":"2024-09-13T17:20:54.958011+0000","last_clean":"2024-09-13T17:20:54.958011+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:20:54.958011+0000","last_undegraded":"2024-09-13T17:20:54.958011+0000","last_fullsized":"2024-09-13T17:20:54.958011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:03.506249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975939+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:20:54.975939+0000","last_peered":"2024-09-13T17:20:54.975939+0000","last_clean":"2024-09-13T17:20:54.975939+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:20:54.975939+0000","last_undegraded":"2024-09-13T17:20:54.975939+0000","last_fullsized":"2024-09-13T17:20:54.975939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969955+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:20:54.969955+0000","last_peered":"2024-09-13T17:20:54.969955+0000","last_clean":"2024-09-13T17:20:54.969955+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:20:54.969955+0000","last_undegraded":"2024-09-13T17:20:54.969955+0000","last_fullsized":"2024-09-13T17:20:54.969955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978607+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:20:54.978607+0000","last_peered":"2024-09-13T17:20:54.978607+0000","last_clean":"2024-09-13T17:20:54.978607+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:20:54.978607+0000","last_undegraded":"2024-09-13T17:20:54.978607+0000","last_fullsized":"2024-09-13T17:20:54.978607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979908+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:20:54.979908+0000","last_peered":"2024-09-13T17:20:54.979908+0000","last_clean":"2024-09-13T17:20:54.979908+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:20:54.979908+0000","last_undegraded":"2024-09-13T17:20:54.979908+0000","last_fullsized":"2024-09-13T17:20:54.979908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961659+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:20:54.961659+0000","last_peered":"2024-09-13T17:20:54.961659+0000","last_clean":"2024-09-13T17:20:54.961659+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:20:54.961659+0000","last_undegraded":"2024-09-13T17:20:54.961659+0000","last_fullsized":"2024-09-13T17:20:54.961659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977776+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:20:54.977776+0000","last_peered":"2024-09-13T17:20:54.977776+0000","last_clean":"2024-09-13T17:20:54.977776+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:20:54.977776+0000","last_undegraded":"2024-09-13T17:20:54.977776+0000","last_fullsized":"2024-09-13T17:20:54.977776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967718+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:20:54.967718+0000","last_peered":"2024-09-13T17:20:54.967718+0000","last_clean":"2024-09-13T17:20:54.967718+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:20:54.967718+0000","last_undegraded":"2024-09-13T17:20:54.967718+0000","last_fullsized":"2024-09-13T17:20:54.967718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969097+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:20:54.969097+0000","last_peered":"2024-09-13T17:20:54.969097+0000","last_clean":"2024-09-13T17:20:54.969097+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:20:54.969097+0000","last_undegraded":"2024-09-13T17:20:54.969097+0000","last_fullsized":"2024-09-13T17:20:54.969097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196836+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:20:55.196836+0000","last_peered":"2024-09-13T17:20:55.196836+0000","last_clean":"2024-09-13T17:20:55.196836+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:20:55.196836+0000","last_undegraded":"2024-09-13T17:20:55.196836+0000","last_fullsized":"2024-09-13T17:20:55.196836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964372+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:20:54.964372+0000","last_peered":"2024-09-13T17:20:54.964372+0000","last_clean":"2024-09-13T17:20:54.964372+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:20:54.964372+0000","last_undegraded":"2024-09-13T17:20:54.964372+0000","last_fullsized":"2024-09-13T17:20:54.964372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187418+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:20:55.187418+0000","last_peered":"2024-09-13T17:20:55.187418+0000","last_clean":"2024-09-13T17:20:55.187418+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:20:55.187418+0000","last_undegraded":"2024-09-13T17:20:55.187418+0000","last_fullsized":"2024-09-13T17:20:55.187418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969378+0000","last_change":"2024-09-13T17:20:50.961962+0000","last_active":"2024-09-13T17:20:54.969378+0000","last_peered":"2024-09-13T17:20:54.969378+0000","last_clean":"2024-09-13T17:20:54.969378+0000","last_became_active":"2024-09-13T17:20:50.959714+0000","last_became_peered":"2024-09-13T17:20:50.959714+0000","last_unstale":"2024-09-13T17:20:54.969378+0000","last_undegraded":"2024-09-13T17:20:54.969378+0000","last_fullsized":"2024-09-13T17:20:54.969378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.191758+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:20:55.191758+0000","last_peered":"2024-09-13T17:20:55.191758+0000","last_clean":"2024-09-13T17:20:55.191758+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:20:55.191758+0000","last_undegraded":"2024-09-13T17:20:55.191758+0000","last_fullsized":"2024-09-13T17:20:55.191758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973023+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:20:54.973023+0000","last_peered":"2024-09-13T17:20:54.973023+0000","last_clean":"2024-09-13T17:20:54.973023+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:20:54.973023+0000","last_undegraded":"2024-09-13T17:20:54.973023+0000","last_fullsized":"2024-09-13T17:20:54.973023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980339+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:20:54.980339+0000","last_peered":"2024-09-13T17:20:54.980339+0000","last_clean":"2024-09-13T17:20:54.980339+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:20:54.980339+0000","last_undegraded":"2024-09-13T17:20:54.980339+0000","last_fullsized":"2024-09-13T17:20:54.980339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980100+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:20:54.980100+0000","last_peered":"2024-09-13T17:20:54.980100+0000","last_clean":"2024-09-13T17:20:54.980100+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:20:54.980100+0000","last_undegraded":"2024-09-13T17:20:54.980100+0000","last_fullsized":"2024-09-13T17:20:54.980100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196594+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:20:55.196594+0000","last_peered":"2024-09-13T17:20:55.196594+0000","last_clean":"2024-09-13T17:20:55.196594+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:20:55.196594+0000","last_undegraded":"2024-09-13T17:20:55.196594+0000","last_fullsized":"2024-09-13T17:20:55.196594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":701079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:21:18.834 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:21:18.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.982+0000 7f25c64c5640 1 Processor -- start 2024-09-13T17:21:18.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.982+0000 7f25c64c5640 1 -- start start 2024-09-13T17:21:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f25c006a2e0 0x7f25c00a0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f25c00a0990 0x7f25c01502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c006c1c0 con 0x7f25c006bde0 2024-09-13T17:21:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c0146950 con 0x7f25c00a0990 2024-09-13T17:21:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c006b380 con 0x7f25c006a2e0 2024-09-13T17:21:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f25c00a0990 0x7f25c01502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f25c00a0990 0x7f25c01502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46170/0 (socket says 172.21.15.167:46170) 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 -- 172.21.15.167:0/3617205221 learned_addr learned my addr 172.21.15.167:0/3617205221 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25b7fff640 1 --2- 172.21.15.167:0/3617205221 >> v2:172.21.15.190:3300/0 conn(0x7f25c006a2e0 0x7f25c00a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 -- 172.21.15.167:0/3617205221 >> v2:172.21.15.190:3300/0 conn(0x7f25c006a2e0 msgr2=0x7f25c00a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 --2- 172.21.15.167:0/3617205221 >> v2:172.21.15.190:3300/0 conn(0x7f25c006a2e0 0x7f25c00a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 -- 172.21.15.167:0/3617205221 >> v1:172.21.15.190:6789/0 conn(0x7f25c006bde0 legacy=0x7f25c00b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 -- 172.21.15.167:0/3617205221 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0145e70 con 0x7f25c00a0990 2024-09-13T17:21:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25b7fff640 1 --2- 172.21.15.167:0/3617205221 >> v2:172.21.15.190:3300/0 conn(0x7f25c006a2e0 0x7f25c00a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c4a62640 1 --2- 172.21.15.167:0/3617205221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01502c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25c00b7240 tx=0x7f25b801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac6ca9b77248091 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25bf7fe640 1 -- 172.21.15.167:0/3617205221 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80a56a0 con 0x7f25c00a0990 2024-09-13T17:21:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25bf7fe640 1 -- 172.21.15.167:0/3617205221 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80a5800 con 0x7f25c00a0990 2024-09-13T17:21:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25bf7fe640 1 -- 172.21.15.167:0/3617205221 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80a5b90 con 0x7f25c00a0990 2024-09-13T17:21:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- 172.21.15.167:0/3617205221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 msgr2=0x7f25c01502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3617205221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01502c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25c00b7240 tx=0x7f25b801c8d0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- 172.21.15.167:0/3617205221 shutdown_connections 2024-09-13T17:21:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3617205221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01502c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3617205221 >> v2:172.21.15.190:3300/0 conn(0x7f25c006a2e0 0x7f25c00a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- 172.21.15.167:0/3617205221 >> 172.21.15.167:0/3617205221 conn(0x7f25c00b7e80 msgr2=0x7f25c00b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- 172.21.15.167:0/3617205221 shutdown_connections 2024-09-13T17:21:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.986+0000 7f25c64c5640 1 -- 172.21.15.167:0/3617205221 wait complete. 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 Processor -- start 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 -- start start 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c006a2e0 0x7f25c013efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c006bde0 0x7f25c009c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01e1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c01433c0 con 0x7f25c00a0990 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0142450 con 0x7f25c006bde0 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c01430e0 con 0x7f25c006a2e0 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01e1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01e1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46182/0 (socket says 172.21.15.167:46182) 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 -- 172.21.15.167:0/3037441228 learned_addr learned my addr 172.21.15.167:0/3037441228 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25b7fff640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c006bde0 0x7f25c009c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25bffff640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c006a2e0 0x7f25c013efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 -- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c006a2e0 msgr2=0x7f25c013efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c006a2e0 0x7f25c013efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 -- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c006bde0 msgr2=0x7f25c009c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c006bde0 0x7f25c009c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 -- 172.21.15.167:0/3037441228 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8009b30 con 0x7f25c00a0990 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25bffff640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c006a2e0 0x7f25c013efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c4a62640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01e1510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f25b801a500 tx=0x7f25b8019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25bd7fa640 1 -- 172.21.15.167:0/3037441228 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80b8670 con 0x7f25c00a0990 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25bd7fa640 1 -- 172.21.15.167:0/3037441228 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80b87d0 con 0x7f25c00a0990 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25bd7fa640 1 -- 172.21.15.167:0/3037441228 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80b8b40 con 0x7f25c00a0990 2024-09-13T17:21:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c013eab0 con 0x7f25c00a0990 2024-09-13T17:21:18.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c0141fe0 con 0x7f25c00a0990 2024-09-13T17:21:18.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c00a0450 con 0x7f25c00a0990 2024-09-13T17:21:18.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.990+0000 7f25bd7fa640 1 -- 172.21.15.167:0/3037441228 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25b80b8ca0 con 0x7f25c00a0990 2024-09-13T17:21:18.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.994+0000 7f25bd7fa640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25a00666e0 0x7f25a0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:18.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.994+0000 7f25bd7fa640 1 -- 172.21.15.167:0/3037441228 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25b811f8a0 con 0x7f25c00a0990 2024-09-13T17:21:18.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.994+0000 7f25bffff640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25a00666e0 0x7f25a0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:18.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.994+0000 7f25bffff640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25a00666e0 0x7f25a0068ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25b0003e40 tx=0x7f25b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:18.998+0000 7f25bd7fa640 1 -- 172.21.15.167:0/3037441228 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25b80ecbb0 con 0x7f25c00a0990 2024-09-13T17:21:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.142+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25c00b6ae0 con 0x7f25a00666e0 2024-09-13T17:21:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.154+0000 7f25bd7fa640 1 -- 172.21.15.167:0/3037441228 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345225 (secure 0 0 0) 0x7f25c00b6ae0 con 0x7f25a00666e0 2024-09-13T17:21:19.162 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:21:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25a00666e0 msgr2=0x7f25a0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25a00666e0 0x7f25a0068ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25b0003e40 tx=0x7f25b0009040 comp rx=0 tx=0).stop 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 msgr2=0x7f25c01e1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01e1510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f25b801a500 tx=0x7f25b8019670 comp rx=0 tx=0).stop 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 shutdown_connections 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f25a00666e0 0x7f25a0068ba0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25c00a0990 0x7f25c01e1510 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25c006bde0 0x7f25c009c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 --2- 172.21.15.167:0/3037441228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25c006a2e0 0x7f25c013efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 >> 172.21.15.167:0/3037441228 conn(0x7f25c00b7e80 msgr2=0x7f25c0099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 shutdown_connections 2024-09-13T17:21:19.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.162+0000 7f25c64c5640 1 -- 172.21.15.167:0/3037441228 wait complete. 2024-09-13T17:21:19.180 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-13T17:21:17.501343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2070506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004892"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978674+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:20:54.978674+0000","last_peered":"2024-09-13T17:20:54.978674+0000","last_clean":"2024-09-13T17:20:54.978674+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:20:54.978674+0000","last_undegraded":"2024-09-13T17:20:54.978674+0000","last_fullsized":"2024-09-13T17:20:54.978674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964650+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:20:54.964650+0000","last_peered":"2024-09-13T17:20:54.964650+0000","last_clean":"2024-09-13T17:20:54.964650+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:20:54.964650+0000","last_undegraded":"2024-09-13T17:20:54.964650+0000","last_fullsized":"2024-09-13T17:20:54.964650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364375+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:20:56.364375+0000","last_peered":"2024-09-13T17:20:56.364375+0000","last_clean":"2024-09-13T17:20:56.364375+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:20:56.364375+0000","last_undegraded":"2024-09-13T17:20:56.364375+0000","last_fullsized":"2024-09-13T17:20:56.364375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964867+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:20:54.964867+0000","last_peered":"2024-09-13T17:20:54.964867+0000","last_clean":"2024-09-13T17:20:54.964867+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:20:54.964867+0000","last_undegraded":"2024-09-13T17:20:54.964867+0000","last_fullsized":"2024-09-13T17:20:54.964867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978333+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:20:54.978333+0000","last_peered":"2024-09-13T17:20:54.978333+0000","last_clean":"2024-09-13T17:20:54.978333+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:20:54.978333+0000","last_undegraded":"2024-09-13T17:20:54.978333+0000","last_fullsized":"2024-09-13T17:20:54.978333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319629+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:20:56.319629+0000","last_peered":"2024-09-13T17:20:56.319629+0000","last_clean":"2024-09-13T17:20:56.319629+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:20:56.319629+0000","last_undegraded":"2024-09-13T17:20:56.319629+0000","last_fullsized":"2024-09-13T17:20:56.319629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196854+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:20:55.196854+0000","last_peered":"2024-09-13T17:20:55.196854+0000","last_clean":"2024-09-13T17:20:55.196854+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:20:55.196854+0000","last_undegraded":"2024-09-13T17:20:55.196854+0000","last_fullsized":"2024-09-13T17:20:55.196854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973231+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:20:54.973231+0000","last_peered":"2024-09-13T17:20:54.973231+0000","last_clean":"2024-09-13T17:20:54.973231+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:20:54.973231+0000","last_undegraded":"2024-09-13T17:20:54.973231+0000","last_fullsized":"2024-09-13T17:20:54.973231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320003+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:20:56.320003+0000","last_peered":"2024-09-13T17:20:56.320003+0000","last_clean":"2024-09-13T17:20:56.320003+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:20:56.320003+0000","last_undegraded":"2024-09-13T17:20:56.320003+0000","last_fullsized":"2024-09-13T17:20:56.320003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195592+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:20:55.195592+0000","last_peered":"2024-09-13T17:20:55.195592+0000","last_clean":"2024-09-13T17:20:55.195592+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:20:55.195592+0000","last_undegraded":"2024-09-13T17:20:55.195592+0000","last_fullsized":"2024-09-13T17:20:55.195592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973550+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:20:54.973550+0000","last_peered":"2024-09-13T17:20:54.973550+0000","last_clean":"2024-09-13T17:20:54.973550+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:20:54.973550+0000","last_undegraded":"2024-09-13T17:20:54.973550+0000","last_fullsized":"2024-09-13T17:20:54.973550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319861+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:20:56.319861+0000","last_peered":"2024-09-13T17:20:56.319861+0000","last_clean":"2024-09-13T17:20:56.319861+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:20:56.319861+0000","last_undegraded":"2024-09-13T17:20:56.319861+0000","last_fullsized":"2024-09-13T17:20:56.319861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971678+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:20:54.971678+0000","last_peered":"2024-09-13T17:20:54.971678+0000","last_clean":"2024-09-13T17:20:54.971678+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:20:54.971678+0000","last_undegraded":"2024-09-13T17:20:54.971678+0000","last_fullsized":"2024-09-13T17:20:54.971678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.195771+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:20:55.195771+0000","last_peered":"2024-09-13T17:20:55.195771+0000","last_clean":"2024-09-13T17:20:55.195771+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:20:55.195771+0000","last_undegraded":"2024-09-13T17:20:55.195771+0000","last_fullsized":"2024-09-13T17:20:55.195771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.321065+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:20:56.321065+0000","last_peered":"2024-09-13T17:20:56.321065+0000","last_clean":"2024-09-13T17:20:56.321065+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:20:56.321065+0000","last_undegraded":"2024-09-13T17:20:56.321065+0000","last_fullsized":"2024-09-13T17:20:56.321065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961879+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:20:54.961879+0000","last_peered":"2024-09-13T17:20:54.961879+0000","last_clean":"2024-09-13T17:20:54.961879+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:20:54.961879+0000","last_undegraded":"2024-09-13T17:20:54.961879+0000","last_fullsized":"2024-09-13T17:20:54.961879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979253+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:20:54.979253+0000","last_peered":"2024-09-13T17:20:54.979253+0000","last_clean":"2024-09-13T17:20:54.979253+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:20:54.979253+0000","last_undegraded":"2024-09-13T17:20:54.979253+0000","last_fullsized":"2024-09-13T17:20:54.979253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320528+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:20:56.320528+0000","last_peered":"2024-09-13T17:20:56.320528+0000","last_clean":"2024-09-13T17:20:56.320528+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:20:56.320528+0000","last_undegraded":"2024-09-13T17:20:56.320528+0000","last_fullsized":"2024-09-13T17:20:56.320528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964725+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:20:54.964725+0000","last_peered":"2024-09-13T17:20:54.964725+0000","last_clean":"2024-09-13T17:20:54.964725+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:20:54.964725+0000","last_undegraded":"2024-09-13T17:20:54.964725+0000","last_fullsized":"2024-09-13T17:20:54.964725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978739+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:20:54.978739+0000","last_peered":"2024-09-13T17:20:54.978739+0000","last_clean":"2024-09-13T17:20:54.978739+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:20:54.978739+0000","last_undegraded":"2024-09-13T17:20:54.978739+0000","last_fullsized":"2024-09-13T17:20:54.978739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357122+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:20:55.357122+0000","last_peered":"2024-09-13T17:20:55.357122+0000","last_clean":"2024-09-13T17:20:55.357122+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:20:55.357122+0000","last_undegraded":"2024-09-13T17:20:55.357122+0000","last_fullsized":"2024-09-13T17:20:55.357122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978042+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:20:54.978042+0000","last_peered":"2024-09-13T17:20:54.978042+0000","last_clean":"2024-09-13T17:20:54.978042+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:20:54.978042+0000","last_undegraded":"2024-09-13T17:20:54.978042+0000","last_fullsized":"2024-09-13T17:20:54.978042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185338+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:20:55.185338+0000","last_peered":"2024-09-13T17:20:55.185338+0000","last_clean":"2024-09-13T17:20:55.185338+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:20:55.185338+0000","last_undegraded":"2024-09-13T17:20:55.185338+0000","last_fullsized":"2024-09-13T17:20:55.185338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320965+0000","last_change":"2024-09-13T17:20:55.001193+0000","last_active":"2024-09-13T17:20:56.320965+0000","last_peered":"2024-09-13T17:20:56.320965+0000","last_clean":"2024-09-13T17:20:56.320965+0000","last_became_active":"2024-09-13T17:20:54.999414+0000","last_became_peered":"2024-09-13T17:20:54.999414+0000","last_unstale":"2024-09-13T17:20:56.320965+0000","last_undegraded":"2024-09-13T17:20:56.320965+0000","last_fullsized":"2024-09-13T17:20:56.320965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978390+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:20:54.978390+0000","last_peered":"2024-09-13T17:20:54.978390+0000","last_clean":"2024-09-13T17:20:54.978390+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:20:54.978390+0000","last_undegraded":"2024-09-13T17:20:54.978390+0000","last_fullsized":"2024-09-13T17:20:54.978390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.974170+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:20:54.974170+0000","last_peered":"2024-09-13T17:20:54.974170+0000","last_clean":"2024-09-13T17:20:54.974170+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:20:54.974170+0000","last_undegraded":"2024-09-13T17:20:54.974170+0000","last_fullsized":"2024-09-13T17:20:54.974170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319977+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:20:56.319977+0000","last_peered":"2024-09-13T17:20:56.319977+0000","last_clean":"2024-09-13T17:20:56.319977+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:20:56.319977+0000","last_undegraded":"2024-09-13T17:20:56.319977+0000","last_fullsized":"2024-09-13T17:20:56.319977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964608+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:20:54.964608+0000","last_peered":"2024-09-13T17:20:54.964608+0000","last_clean":"2024-09-13T17:20:54.964608+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:20:54.964608+0000","last_undegraded":"2024-09-13T17:20:54.964608+0000","last_fullsized":"2024-09-13T17:20:54.964608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980238+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:20:54.980238+0000","last_peered":"2024-09-13T17:20:54.980238+0000","last_clean":"2024-09-13T17:20:54.980238+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:20:54.980238+0000","last_undegraded":"2024-09-13T17:20:54.980238+0000","last_fullsized":"2024-09-13T17:20:54.980238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363397+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:20:56.363397+0000","last_peered":"2024-09-13T17:20:56.363397+0000","last_clean":"2024-09-13T17:20:56.363397+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:20:56.363397+0000","last_undegraded":"2024-09-13T17:20:56.363397+0000","last_fullsized":"2024-09-13T17:20:56.363397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980577+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:20:54.980577+0000","last_peered":"2024-09-13T17:20:54.980577+0000","last_clean":"2024-09-13T17:20:54.980577+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:20:54.980577+0000","last_undegraded":"2024-09-13T17:20:54.980577+0000","last_fullsized":"2024-09-13T17:20:54.980577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197302+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:20:55.197302+0000","last_peered":"2024-09-13T17:20:55.197302+0000","last_clean":"2024-09-13T17:20:55.197302+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:20:55.197302+0000","last_undegraded":"2024-09-13T17:20:55.197302+0000","last_fullsized":"2024-09-13T17:20:55.197302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363358+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:20:56.363358+0000","last_peered":"2024-09-13T17:20:56.363358+0000","last_clean":"2024-09-13T17:20:56.363358+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:20:56.363358+0000","last_undegraded":"2024-09-13T17:20:56.363358+0000","last_fullsized":"2024-09-13T17:20:56.363358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973762+0000","last_change":"2024-09-13T17:20:50.971732+0000","last_active":"2024-09-13T17:20:54.973762+0000","last_peered":"2024-09-13T17:20:54.973762+0000","last_clean":"2024-09-13T17:20:54.973762+0000","last_became_active":"2024-09-13T17:20:50.964584+0000","last_became_peered":"2024-09-13T17:20:50.964584+0000","last_unstale":"2024-09-13T17:20:54.973762+0000","last_undegraded":"2024-09-13T17:20:54.973762+0000","last_fullsized":"2024-09-13T17:20:54.973762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980696+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:20:54.980696+0000","last_peered":"2024-09-13T17:20:54.980696+0000","last_clean":"2024-09-13T17:20:54.980696+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:20:54.980696+0000","last_undegraded":"2024-09-13T17:20:54.980696+0000","last_fullsized":"2024-09-13T17:20:54.980696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356150+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:20:55.356150+0000","last_peered":"2024-09-13T17:20:55.356150+0000","last_clean":"2024-09-13T17:20:55.356150+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:20:55.356150+0000","last_undegraded":"2024-09-13T17:20:55.356150+0000","last_fullsized":"2024-09-13T17:20:55.356150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.988158+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:20:54.988158+0000","last_peered":"2024-09-13T17:20:54.988158+0000","last_clean":"2024-09-13T17:20:54.988158+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:20:54.988158+0000","last_undegraded":"2024-09-13T17:20:54.988158+0000","last_fullsized":"2024-09-13T17:20:54.988158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971489+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:20:54.971489+0000","last_peered":"2024-09-13T17:20:54.971489+0000","last_clean":"2024-09-13T17:20:54.971489+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:20:54.971489+0000","last_undegraded":"2024-09-13T17:20:54.971489+0000","last_fullsized":"2024-09-13T17:20:54.971489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356971+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:20:55.356971+0000","last_peered":"2024-09-13T17:20:55.356971+0000","last_clean":"2024-09-13T17:20:55.356971+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:20:55.356971+0000","last_undegraded":"2024-09-13T17:20:55.356971+0000","last_fullsized":"2024-09-13T17:20:55.356971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979502+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:20:54.979502+0000","last_peered":"2024-09-13T17:20:54.979502+0000","last_clean":"2024-09-13T17:20:54.979502+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:20:54.979502+0000","last_undegraded":"2024-09-13T17:20:54.979502+0000","last_fullsized":"2024-09-13T17:20:54.979502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958088+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:20:54.958088+0000","last_peered":"2024-09-13T17:20:54.958088+0000","last_clean":"2024-09-13T17:20:54.958088+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:20:54.958088+0000","last_undegraded":"2024-09-13T17:20:54.958088+0000","last_fullsized":"2024-09-13T17:20:54.958088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:09.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.357445+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:20:55.357445+0000","last_peered":"2024-09-13T17:20:55.357445+0000","last_clean":"2024-09-13T17:20:55.357445+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:20:55.357445+0000","last_undegraded":"2024-09-13T17:20:55.357445+0000","last_fullsized":"2024-09-13T17:20:55.357445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977867+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:20:54.977867+0000","last_peered":"2024-09-13T17:20:54.977867+0000","last_clean":"2024-09-13T17:20:54.977867+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:20:54.977867+0000","last_undegraded":"2024-09-13T17:20:54.977867+0000","last_fullsized":"2024-09-13T17:20:54.977867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185295+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:20:55.185295+0000","last_peered":"2024-09-13T17:20:55.185295+0000","last_clean":"2024-09-13T17:20:55.185295+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:20:55.185295+0000","last_undegraded":"2024-09-13T17:20:55.185295+0000","last_fullsized":"2024-09-13T17:20:55.185295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363798+0000","last_change":"2024-09-13T17:20:55.185849+0000","last_active":"2024-09-13T17:20:56.363798+0000","last_peered":"2024-09-13T17:20:56.363798+0000","last_clean":"2024-09-13T17:20:56.363798+0000","last_became_active":"2024-09-13T17:20:55.185460+0000","last_became_peered":"2024-09-13T17:20:55.185460+0000","last_unstale":"2024-09-13T17:20:56.363798+0000","last_undegraded":"2024-09-13T17:20:56.363798+0000","last_fullsized":"2024-09-13T17:20:56.363798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961006+0000","last_change":"2024-09-13T17:20:50.969430+0000","last_active":"2024-09-13T17:20:54.961006+0000","last_peered":"2024-09-13T17:20:54.961006+0000","last_clean":"2024-09-13T17:20:54.961006+0000","last_became_active":"2024-09-13T17:20:50.969161+0000","last_became_peered":"2024-09-13T17:20:50.969161+0000","last_unstale":"2024-09-13T17:20:54.961006+0000","last_undegraded":"2024-09-13T17:20:54.961006+0000","last_fullsized":"2024-09-13T17:20:54.961006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.972323+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:20:54.972323+0000","last_peered":"2024-09-13T17:20:54.972323+0000","last_clean":"2024-09-13T17:20:54.972323+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:20:54.972323+0000","last_undegraded":"2024-09-13T17:20:54.972323+0000","last_fullsized":"2024-09-13T17:20:54.972323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.185441+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:20:55.185441+0000","last_peered":"2024-09-13T17:20:55.185441+0000","last_clean":"2024-09-13T17:20:55.185441+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:20:55.185441+0000","last_undegraded":"2024-09-13T17:20:55.185441+0000","last_fullsized":"2024-09-13T17:20:55.185441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361982+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:20:55.361982+0000","last_peered":"2024-09-13T17:20:55.361982+0000","last_clean":"2024-09-13T17:20:55.361982+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:20:55.361982+0000","last_undegraded":"2024-09-13T17:20:55.361982+0000","last_fullsized":"2024-09-13T17:20:55.361982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196583+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:20:55.196583+0000","last_peered":"2024-09-13T17:20:55.196583+0000","last_clean":"2024-09-13T17:20:55.196583+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:20:55.196583+0000","last_undegraded":"2024-09-13T17:20:55.196583+0000","last_fullsized":"2024-09-13T17:20:55.196583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958622+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:20:54.958622+0000","last_peered":"2024-09-13T17:20:54.958622+0000","last_clean":"2024-09-13T17:20:54.958622+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:20:54.958622+0000","last_undegraded":"2024-09-13T17:20:54.958622+0000","last_fullsized":"2024-09-13T17:20:54.958622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.361044+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:20:55.361044+0000","last_peered":"2024-09-13T17:20:55.361044+0000","last_clean":"2024-09-13T17:20:55.361044+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:20:55.361044+0000","last_undegraded":"2024-09-13T17:20:55.361044+0000","last_fullsized":"2024-09-13T17:20:55.361044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973440+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:20:54.973440+0000","last_peered":"2024-09-13T17:20:54.973440+0000","last_clean":"2024-09-13T17:20:54.973440+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:20:54.973440+0000","last_undegraded":"2024-09-13T17:20:54.973440+0000","last_fullsized":"2024-09-13T17:20:54.973440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980090+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:20:54.980090+0000","last_peered":"2024-09-13T17:20:54.980090+0000","last_clean":"2024-09-13T17:20:54.980090+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:20:54.980090+0000","last_undegraded":"2024-09-13T17:20:54.980090+0000","last_fullsized":"2024-09-13T17:20:54.980090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363528+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:20:56.363528+0000","last_peered":"2024-09-13T17:20:56.363528+0000","last_clean":"2024-09-13T17:20:56.363528+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:20:56.363528+0000","last_undegraded":"2024-09-13T17:20:56.363528+0000","last_fullsized":"2024-09-13T17:20:56.363528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197060+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:20:55.197060+0000","last_peered":"2024-09-13T17:20:55.197060+0000","last_clean":"2024-09-13T17:20:55.197060+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:20:55.197060+0000","last_undegraded":"2024-09-13T17:20:55.197060+0000","last_fullsized":"2024-09-13T17:20:55.197060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958535+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:20:54.958535+0000","last_peered":"2024-09-13T17:20:54.958535+0000","last_clean":"2024-09-13T17:20:54.958535+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:20:54.958535+0000","last_undegraded":"2024-09-13T17:20:54.958535+0000","last_fullsized":"2024-09-13T17:20:54.958535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:33.533450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.326297+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:20:56.326297+0000","last_peered":"2024-09-13T17:20:56.326297+0000","last_clean":"2024-09-13T17:20:56.326297+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:20:56.326297+0000","last_undegraded":"2024-09-13T17:20:56.326297+0000","last_fullsized":"2024-09-13T17:20:56.326297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196551+0000","last_change":"2024-09-13T17:20:50.999071+0000","last_active":"2024-09-13T17:20:55.196551+0000","last_peered":"2024-09-13T17:20:55.196551+0000","last_clean":"2024-09-13T17:20:55.196551+0000","last_became_active":"2024-09-13T17:20:50.998444+0000","last_became_peered":"2024-09-13T17:20:50.998444+0000","last_unstale":"2024-09-13T17:20:55.196551+0000","last_undegraded":"2024-09-13T17:20:55.196551+0000","last_fullsized":"2024-09-13T17:20:55.196551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967211+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:20:54.967211+0000","last_peered":"2024-09-13T17:20:54.967211+0000","last_clean":"2024-09-13T17:20:54.967211+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:20:54.967211+0000","last_undegraded":"2024-09-13T17:20:54.967211+0000","last_fullsized":"2024-09-13T17:20:54.967211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.319624+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:20:56.319624+0000","last_peered":"2024-09-13T17:20:56.319624+0000","last_clean":"2024-09-13T17:20:56.319624+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:20:56.319624+0000","last_undegraded":"2024-09-13T17:20:56.319624+0000","last_fullsized":"2024-09-13T17:20:56.319624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187527+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:20:55.187527+0000","last_peered":"2024-09-13T17:20:55.187527+0000","last_clean":"2024-09-13T17:20:55.187527+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:20:55.187527+0000","last_undegraded":"2024-09-13T17:20:55.187527+0000","last_fullsized":"2024-09-13T17:20:55.187527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957804+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:20:54.957804+0000","last_peered":"2024-09-13T17:20:54.957804+0000","last_clean":"2024-09-13T17:20:54.957804+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:20:54.957804+0000","last_undegraded":"2024-09-13T17:20:54.957804+0000","last_fullsized":"2024-09-13T17:20:54.957804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:25.139372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363726+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:20:56.363726+0000","last_peered":"2024-09-13T17:20:56.363726+0000","last_clean":"2024-09-13T17:20:56.363726+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:20:56.363726+0000","last_undegraded":"2024-09-13T17:20:56.363726+0000","last_fullsized":"2024-09-13T17:20:56.363726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969429+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:20:54.969429+0000","last_peered":"2024-09-13T17:20:54.969429+0000","last_clean":"2024-09-13T17:20:54.969429+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:20:54.969429+0000","last_undegraded":"2024-09-13T17:20:54.969429+0000","last_fullsized":"2024-09-13T17:20:54.969429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.968862+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:20:54.968862+0000","last_peered":"2024-09-13T17:20:54.968862+0000","last_clean":"2024-09-13T17:20:54.968862+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:20:54.968862+0000","last_undegraded":"2024-09-13T17:20:54.968862+0000","last_fullsized":"2024-09-13T17:20:54.968862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364693+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:20:56.364693+0000","last_peered":"2024-09-13T17:20:56.364693+0000","last_clean":"2024-09-13T17:20:56.364693+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:20:56.364693+0000","last_undegraded":"2024-09-13T17:20:56.364693+0000","last_fullsized":"2024-09-13T17:20:56.364693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.194492+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:20:55.194492+0000","last_peered":"2024-09-13T17:20:55.194492+0000","last_clean":"2024-09-13T17:20:55.194492+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:20:55.194492+0000","last_undegraded":"2024-09-13T17:20:55.194492+0000","last_fullsized":"2024-09-13T17:20:55.194492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969703+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:20:54.969703+0000","last_peered":"2024-09-13T17:20:54.969703+0000","last_clean":"2024-09-13T17:20:54.969703+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:20:54.969703+0000","last_undegraded":"2024-09-13T17:20:54.969703+0000","last_fullsized":"2024-09-13T17:20:54.969703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364409+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:20:56.364409+0000","last_peered":"2024-09-13T17:20:56.364409+0000","last_clean":"2024-09-13T17:20:56.364409+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:20:56.364409+0000","last_undegraded":"2024-09-13T17:20:56.364409+0000","last_fullsized":"2024-09-13T17:20:56.364409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980016+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:20:54.980016+0000","last_peered":"2024-09-13T17:20:54.980016+0000","last_clean":"2024-09-13T17:20:54.980016+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:20:54.980016+0000","last_undegraded":"2024-09-13T17:20:54.980016+0000","last_fullsized":"2024-09-13T17:20:54.980016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978568+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:20:54.978568+0000","last_peered":"2024-09-13T17:20:54.978568+0000","last_clean":"2024-09-13T17:20:54.978568+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:20:54.978568+0000","last_undegraded":"2024-09-13T17:20:54.978568+0000","last_fullsized":"2024-09-13T17:20:54.978568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.327970+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:20:56.327970+0000","last_peered":"2024-09-13T17:20:56.327970+0000","last_clean":"2024-09-13T17:20:56.327970+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:20:56.327970+0000","last_undegraded":"2024-09-13T17:20:56.327970+0000","last_fullsized":"2024-09-13T17:20:56.327970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196325+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:20:55.196325+0000","last_peered":"2024-09-13T17:20:55.196325+0000","last_clean":"2024-09-13T17:20:55.196325+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:20:55.196325+0000","last_undegraded":"2024-09-13T17:20:55.196325+0000","last_fullsized":"2024-09-13T17:20:55.196325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:21:00.906533+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:21:00.906533+0000","last_peered":"2024-09-13T17:21:00.906533+0000","last_clean":"2024-09-13T17:21:00.906533+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:21:00.906533+0000","last_undegraded":"2024-09-13T17:21:00.906533+0000","last_fullsized":"2024-09-13T17:21:00.906533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.356271+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:20:55.356271+0000","last_peered":"2024-09-13T17:20:55.356271+0000","last_clean":"2024-09-13T17:20:55.356271+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:20:55.356271+0000","last_undegraded":"2024-09-13T17:20:55.356271+0000","last_fullsized":"2024-09-13T17:20:55.356271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977964+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:20:54.977964+0000","last_peered":"2024-09-13T17:20:54.977964+0000","last_clean":"2024-09-13T17:20:54.977964+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:20:54.977964+0000","last_undegraded":"2024-09-13T17:20:54.977964+0000","last_fullsized":"2024-09-13T17:20:54.977964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979963+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:20:54.979963+0000","last_peered":"2024-09-13T17:20:54.979963+0000","last_clean":"2024-09-13T17:20:54.979963+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:20:54.979963+0000","last_undegraded":"2024-09-13T17:20:54.979963+0000","last_fullsized":"2024-09-13T17:20:54.979963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.320279+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:20:56.320279+0000","last_peered":"2024-09-13T17:20:56.320279+0000","last_clean":"2024-09-13T17:20:56.320279+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:20:56.320279+0000","last_undegraded":"2024-09-13T17:20:56.320279+0000","last_fullsized":"2024-09-13T17:20:56.320279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978448+0000","last_change":"2024-09-13T17:20:50.950985+0000","last_active":"2024-09-13T17:20:54.978448+0000","last_peered":"2024-09-13T17:20:54.978448+0000","last_clean":"2024-09-13T17:20:54.978448+0000","last_became_active":"2024-09-13T17:20:50.950732+0000","last_became_peered":"2024-09-13T17:20:50.950732+0000","last_unstale":"2024-09-13T17:20:54.978448+0000","last_undegraded":"2024-09-13T17:20:54.978448+0000","last_fullsized":"2024-09-13T17:20:54.978448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:20.173904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975473+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:20:54.975473+0000","last_peered":"2024-09-13T17:20:54.975473+0000","last_clean":"2024-09-13T17:20:54.975473+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:20:54.975473+0000","last_undegraded":"2024-09-13T17:20:54.975473+0000","last_fullsized":"2024-09-13T17:20:54.975473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363687+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:20:56.363687+0000","last_peered":"2024-09-13T17:20:56.363687+0000","last_clean":"2024-09-13T17:20:56.363687+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:20:56.363687+0000","last_undegraded":"2024-09-13T17:20:56.363687+0000","last_fullsized":"2024-09-13T17:20:56.363687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975343+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:20:54.975343+0000","last_peered":"2024-09-13T17:20:54.975343+0000","last_clean":"2024-09-13T17:20:54.975343+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:20:54.975343+0000","last_undegraded":"2024-09-13T17:20:54.975343+0000","last_fullsized":"2024-09-13T17:20:54.975343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973950+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:20:54.973950+0000","last_peered":"2024-09-13T17:20:54.973950+0000","last_clean":"2024-09-13T17:20:54.973950+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:20:54.973950+0000","last_undegraded":"2024-09-13T17:20:54.973950+0000","last_fullsized":"2024-09-13T17:20:54.973950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364471+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:20:56.364471+0000","last_peered":"2024-09-13T17:20:56.364471+0000","last_clean":"2024-09-13T17:20:56.364471+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:20:56.364471+0000","last_undegraded":"2024-09-13T17:20:56.364471+0000","last_fullsized":"2024-09-13T17:20:56.364471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363677+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:20:56.363677+0000","last_peered":"2024-09-13T17:20:56.363677+0000","last_clean":"2024-09-13T17:20:56.363677+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:20:56.363677+0000","last_undegraded":"2024-09-13T17:20:56.363677+0000","last_fullsized":"2024-09-13T17:20:56.363677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978733+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:20:54.978733+0000","last_peered":"2024-09-13T17:20:54.978733+0000","last_clean":"2024-09-13T17:20:54.978733+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:20:54.978733+0000","last_undegraded":"2024-09-13T17:20:54.978733+0000","last_fullsized":"2024-09-13T17:20:54.978733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970268+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:20:54.970268+0000","last_peered":"2024-09-13T17:20:54.970268+0000","last_clean":"2024-09-13T17:20:54.970268+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:20:54.970268+0000","last_undegraded":"2024-09-13T17:20:54.970268+0000","last_fullsized":"2024-09-13T17:20:54.970268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.362338+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:20:55.362338+0000","last_peered":"2024-09-13T17:20:55.362338+0000","last_clean":"2024-09-13T17:20:55.362338+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:20:55.362338+0000","last_undegraded":"2024-09-13T17:20:55.362338+0000","last_fullsized":"2024-09-13T17:20:55.362338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964603+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:20:54.964603+0000","last_peered":"2024-09-13T17:20:54.964603+0000","last_clean":"2024-09-13T17:20:54.964603+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:20:54.964603+0000","last_undegraded":"2024-09-13T17:20:54.964603+0000","last_fullsized":"2024-09-13T17:20:54.964603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.965450+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:20:54.965450+0000","last_peered":"2024-09-13T17:20:54.965450+0000","last_clean":"2024-09-13T17:20:54.965450+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:20:54.965450+0000","last_undegraded":"2024-09-13T17:20:54.965450+0000","last_fullsized":"2024-09-13T17:20:54.965450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.971921+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:20:54.971921+0000","last_peered":"2024-09-13T17:20:54.971921+0000","last_clean":"2024-09-13T17:20:54.971921+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:20:54.971921+0000","last_undegraded":"2024-09-13T17:20:54.971921+0000","last_fullsized":"2024-09-13T17:20:54.971921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978472+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:20:54.978472+0000","last_peered":"2024-09-13T17:20:54.978472+0000","last_clean":"2024-09-13T17:20:54.978472+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:20:54.978472+0000","last_undegraded":"2024-09-13T17:20:54.978472+0000","last_fullsized":"2024-09-13T17:20:54.978472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.363860+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:20:56.363860+0000","last_peered":"2024-09-13T17:20:56.363860+0000","last_clean":"2024-09-13T17:20:56.363860+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:20:56.363860+0000","last_undegraded":"2024-09-13T17:20:56.363860+0000","last_fullsized":"2024-09-13T17:20:56.363860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:31.608726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.962109+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:20:54.962109+0000","last_peered":"2024-09-13T17:20:54.962109+0000","last_clean":"2024-09-13T17:20:54.962109+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:20:54.962109+0000","last_undegraded":"2024-09-13T17:20:54.962109+0000","last_fullsized":"2024-09-13T17:20:54.962109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967803+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:20:54.967803+0000","last_peered":"2024-09-13T17:20:54.967803+0000","last_clean":"2024-09-13T17:20:54.967803+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:20:54.967803+0000","last_undegraded":"2024-09-13T17:20:54.967803+0000","last_fullsized":"2024-09-13T17:20:54.967803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T17:20:56.364614+0000","last_change":"2024-09-13T17:20:55.004868+0000","last_active":"2024-09-13T17:20:56.364614+0000","last_peered":"2024-09-13T17:20:56.364614+0000","last_clean":"2024-09-13T17:20:56.364614+0000","last_became_active":"2024-09-13T17:20:55.004397+0000","last_became_peered":"2024-09-13T17:20:55.004397+0000","last_unstale":"2024-09-13T17:20:56.364614+0000","last_undegraded":"2024-09-13T17:20:56.364614+0000","last_fullsized":"2024-09-13T17:20:56.364614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:51.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969083+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:20:54.969083+0000","last_peered":"2024-09-13T17:20:54.969083+0000","last_clean":"2024-09-13T17:20:54.969083+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:20:54.969083+0000","last_undegraded":"2024-09-13T17:20:54.969083+0000","last_fullsized":"2024-09-13T17:20:54.969083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.957932+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:20:54.957932+0000","last_peered":"2024-09-13T17:20:54.957932+0000","last_clean":"2024-09-13T17:20:54.957932+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:20:54.957932+0000","last_undegraded":"2024-09-13T17:20:54.957932+0000","last_fullsized":"2024-09-13T17:20:54.957932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:44.697368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969569+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:20:54.969569+0000","last_peered":"2024-09-13T17:20:54.969569+0000","last_clean":"2024-09-13T17:20:54.969569+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:20:54.969569+0000","last_undegraded":"2024-09-13T17:20:54.969569+0000","last_fullsized":"2024-09-13T17:20:54.969569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978286+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:20:54.978286+0000","last_peered":"2024-09-13T17:20:54.978286+0000","last_clean":"2024-09-13T17:20:54.978286+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:20:54.978286+0000","last_undegraded":"2024-09-13T17:20:54.978286+0000","last_fullsized":"2024-09-13T17:20:54.978286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966771+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:20:54.966771+0000","last_peered":"2024-09-13T17:20:54.966771+0000","last_clean":"2024-09-13T17:20:54.966771+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:20:54.966771+0000","last_undegraded":"2024-09-13T17:20:54.966771+0000","last_fullsized":"2024-09-13T17:20:54.966771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979791+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:20:54.979791+0000","last_peered":"2024-09-13T17:20:54.979791+0000","last_clean":"2024-09-13T17:20:54.979791+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:20:54.979791+0000","last_undegraded":"2024-09-13T17:20:54.979791+0000","last_fullsized":"2024-09-13T17:20:54.979791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969316+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:20:54.969316+0000","last_peered":"2024-09-13T17:20:54.969316+0000","last_clean":"2024-09-13T17:20:54.969316+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:20:54.969316+0000","last_undegraded":"2024-09-13T17:20:54.969316+0000","last_fullsized":"2024-09-13T17:20:54.969316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964475+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:20:54.964475+0000","last_peered":"2024-09-13T17:20:54.964475+0000","last_clean":"2024-09-13T17:20:54.964475+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:20:54.964475+0000","last_undegraded":"2024-09-13T17:20:54.964475+0000","last_fullsized":"2024-09-13T17:20:54.964475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.970101+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:20:54.970101+0000","last_peered":"2024-09-13T17:20:54.970101+0000","last_clean":"2024-09-13T17:20:54.970101+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:20:54.970101+0000","last_undegraded":"2024-09-13T17:20:54.970101+0000","last_fullsized":"2024-09-13T17:20:54.970101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.963584+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:20:54.963584+0000","last_peered":"2024-09-13T17:20:54.963584+0000","last_clean":"2024-09-13T17:20:54.963584+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:20:54.963584+0000","last_undegraded":"2024-09-13T17:20:54.963584+0000","last_fullsized":"2024-09-13T17:20:54.963584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969472+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:20:54.969472+0000","last_peered":"2024-09-13T17:20:54.969472+0000","last_clean":"2024-09-13T17:20:54.969472+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:20:54.969472+0000","last_undegraded":"2024-09-13T17:20:54.969472+0000","last_fullsized":"2024-09-13T17:20:54.969472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978177+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:20:54.978177+0000","last_peered":"2024-09-13T17:20:54.978177+0000","last_clean":"2024-09-13T17:20:54.978177+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:20:54.978177+0000","last_undegraded":"2024-09-13T17:20:54.978177+0000","last_fullsized":"2024-09-13T17:20:54.978177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.966978+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:20:54.966978+0000","last_peered":"2024-09-13T17:20:54.966978+0000","last_clean":"2024-09-13T17:20:54.966978+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:20:54.966978+0000","last_undegraded":"2024-09-13T17:20:54.966978+0000","last_fullsized":"2024-09-13T17:20:54.966978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.197080+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:20:55.197080+0000","last_peered":"2024-09-13T17:20:55.197080+0000","last_clean":"2024-09-13T17:20:55.197080+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:20:55.197080+0000","last_undegraded":"2024-09-13T17:20:55.197080+0000","last_fullsized":"2024-09-13T17:20:55.197080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.958011+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:20:54.958011+0000","last_peered":"2024-09-13T17:20:54.958011+0000","last_clean":"2024-09-13T17:20:54.958011+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:20:54.958011+0000","last_undegraded":"2024-09-13T17:20:54.958011+0000","last_fullsized":"2024-09-13T17:20:54.958011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:03.506249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.975939+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:20:54.975939+0000","last_peered":"2024-09-13T17:20:54.975939+0000","last_clean":"2024-09-13T17:20:54.975939+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:20:54.975939+0000","last_undegraded":"2024-09-13T17:20:54.975939+0000","last_fullsized":"2024-09-13T17:20:54.975939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969955+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:20:54.969955+0000","last_peered":"2024-09-13T17:20:54.969955+0000","last_clean":"2024-09-13T17:20:54.969955+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:20:54.969955+0000","last_undegraded":"2024-09-13T17:20:54.969955+0000","last_fullsized":"2024-09-13T17:20:54.969955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.978607+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:20:54.978607+0000","last_peered":"2024-09-13T17:20:54.978607+0000","last_clean":"2024-09-13T17:20:54.978607+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:20:54.978607+0000","last_undegraded":"2024-09-13T17:20:54.978607+0000","last_fullsized":"2024-09-13T17:20:54.978607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.979908+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:20:54.979908+0000","last_peered":"2024-09-13T17:20:54.979908+0000","last_clean":"2024-09-13T17:20:54.979908+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:20:54.979908+0000","last_undegraded":"2024-09-13T17:20:54.979908+0000","last_fullsized":"2024-09-13T17:20:54.979908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.961659+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:20:54.961659+0000","last_peered":"2024-09-13T17:20:54.961659+0000","last_clean":"2024-09-13T17:20:54.961659+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:20:54.961659+0000","last_undegraded":"2024-09-13T17:20:54.961659+0000","last_fullsized":"2024-09-13T17:20:54.961659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.977776+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:20:54.977776+0000","last_peered":"2024-09-13T17:20:54.977776+0000","last_clean":"2024-09-13T17:20:54.977776+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:20:54.977776+0000","last_undegraded":"2024-09-13T17:20:54.977776+0000","last_fullsized":"2024-09-13T17:20:54.977776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.967718+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:20:54.967718+0000","last_peered":"2024-09-13T17:20:54.967718+0000","last_clean":"2024-09-13T17:20:54.967718+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:20:54.967718+0000","last_undegraded":"2024-09-13T17:20:54.967718+0000","last_fullsized":"2024-09-13T17:20:54.967718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969097+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:20:54.969097+0000","last_peered":"2024-09-13T17:20:54.969097+0000","last_clean":"2024-09-13T17:20:54.969097+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:20:54.969097+0000","last_undegraded":"2024-09-13T17:20:54.969097+0000","last_fullsized":"2024-09-13T17:20:54.969097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196836+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:20:55.196836+0000","last_peered":"2024-09-13T17:20:55.196836+0000","last_clean":"2024-09-13T17:20:55.196836+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:20:55.196836+0000","last_undegraded":"2024-09-13T17:20:55.196836+0000","last_fullsized":"2024-09-13T17:20:55.196836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.964372+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:20:54.964372+0000","last_peered":"2024-09-13T17:20:54.964372+0000","last_clean":"2024-09-13T17:20:54.964372+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:20:54.964372+0000","last_undegraded":"2024-09-13T17:20:54.964372+0000","last_fullsized":"2024-09-13T17:20:54.964372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.187418+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:20:55.187418+0000","last_peered":"2024-09-13T17:20:55.187418+0000","last_clean":"2024-09-13T17:20:55.187418+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:20:55.187418+0000","last_undegraded":"2024-09-13T17:20:55.187418+0000","last_fullsized":"2024-09-13T17:20:55.187418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.969378+0000","last_change":"2024-09-13T17:20:50.961962+0000","last_active":"2024-09-13T17:20:54.969378+0000","last_peered":"2024-09-13T17:20:54.969378+0000","last_clean":"2024-09-13T17:20:54.969378+0000","last_became_active":"2024-09-13T17:20:50.959714+0000","last_became_peered":"2024-09-13T17:20:50.959714+0000","last_unstale":"2024-09-13T17:20:54.969378+0000","last_undegraded":"2024-09-13T17:20:54.969378+0000","last_fullsized":"2024-09-13T17:20:54.969378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.191758+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:20:55.191758+0000","last_peered":"2024-09-13T17:20:55.191758+0000","last_clean":"2024-09-13T17:20:55.191758+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:20:55.191758+0000","last_undegraded":"2024-09-13T17:20:55.191758+0000","last_fullsized":"2024-09-13T17:20:55.191758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.973023+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:20:54.973023+0000","last_peered":"2024-09-13T17:20:54.973023+0000","last_clean":"2024-09-13T17:20:54.973023+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:20:54.973023+0000","last_undegraded":"2024-09-13T17:20:54.973023+0000","last_fullsized":"2024-09-13T17:20:54.973023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980339+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:20:54.980339+0000","last_peered":"2024-09-13T17:20:54.980339+0000","last_clean":"2024-09-13T17:20:54.980339+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:20:54.980339+0000","last_undegraded":"2024-09-13T17:20:54.980339+0000","last_fullsized":"2024-09-13T17:20:54.980339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:54.980100+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:20:54.980100+0000","last_peered":"2024-09-13T17:20:54.980100+0000","last_clean":"2024-09-13T17:20:54.980100+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:20:54.980100+0000","last_undegraded":"2024-09-13T17:20:54.980100+0000","last_fullsized":"2024-09-13T17:20:54.980100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T17:20:55.196594+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:20:55.196594+0000","last_peered":"2024-09-13T17:20:55.196594+0000","last_clean":"2024-09-13T17:20:55.196594+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:20:55.196594+0000","last_undegraded":"2024-09-13T17:20:55.196594+0000","last_fullsized":"2024-09-13T17:20:55.196594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":701079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:21:19.186 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:21:19.186 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T17:21:19.186 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T17:21:19.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T17:21:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdb5270640 1 Processor -- start 2024-09-13T17:21:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdb5270640 1 -- start start 2024-09-13T17:21:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdb5270640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb00b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdb5270640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efdb0070ff0 0x7efdb014e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdb5270640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb0071b10 con 0x7efdb0070bb0 2024-09-13T17:21:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdb5270640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb006f7f0 con 0x7efdb0070ff0 2024-09-13T17:21:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdb5270640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00b0ea0 con 0x7efdb006f0f0 2024-09-13T17:21:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdaf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efdb0070ff0 0x7efdb014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdae7fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efdb0070bb0 0x7efdb013d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35282/0 (socket says 172.21.15.167:35282) 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdae7fc640 1 -- 172.21.15.167:0/237481204 learned_addr learned my addr 172.21.15.167:0/237481204 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdaeffd640 1 --2- 172.21.15.167:0/237481204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb00b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdaf7fe640 1 -- 172.21.15.167:0/237481204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 msgr2=0x7efdb00b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdaf7fe640 1 --2- 172.21.15.167:0/237481204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb00b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdaf7fe640 1 -- 172.21.15.167:0/237481204 >> v1:172.21.15.167:6789/0 conn(0x7efdb0070bb0 legacy=0x7efdb013d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdaf7fe640 1 -- 172.21.15.167:0/237481204 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0071df0 con 0x7efdb0070ff0 2024-09-13T17:21:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.330+0000 7efdaeffd640 1 --2- 172.21.15.167:0/237481204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb00b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdaf7fe640 1 --2- 172.21.15.167:0/237481204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb014e160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efda80097f0 tx=0x7efda801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef00e7390c98c8c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdadffb640 1 -- 172.21.15.167:0/237481204 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80ad680 con 0x7efdb0070ff0 2024-09-13T17:21:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdadffb640 1 -- 172.21.15.167:0/237481204 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda80ad7e0 con 0x7efdb0070ff0 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdadffb640 1 -- 172.21.15.167:0/237481204 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80adb70 con 0x7efdb0070ff0 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- 172.21.15.167:0/237481204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 msgr2=0x7efdb014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 --2- 172.21.15.167:0/237481204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb014e160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efda80097f0 tx=0x7efda801c380 comp rx=0 tx=0).stop 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- 172.21.15.167:0/237481204 shutdown_connections 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 --2- 172.21.15.167:0/237481204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb014e160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 --2- 172.21.15.167:0/237481204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb00b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- 172.21.15.167:0/237481204 >> 172.21.15.167:0/237481204 conn(0x7efdb00b7250 msgr2=0x7efdb00b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- 172.21.15.167:0/237481204 shutdown_connections 2024-09-13T17:21:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- 172.21.15.167:0/237481204 wait complete. 2024-09-13T17:21:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 Processor -- start 2024-09-13T17:21:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- start start 2024-09-13T17:21:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb0143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb0070bb0 0x7efdb0136e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb0141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb013aa00 con 0x7efdb0070ff0 2024-09-13T17:21:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0143aa0 con 0x7efdb0070bb0 2024-09-13T17:21:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdb5270640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0143d80 con 0x7efdb006f0f0 2024-09-13T17:21:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb0141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb0141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46196/0 (socket says 172.21.15.167:46196) 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.334+0000 7efdaf7fe640 1 -- 172.21.15.167:0/2474918588 learned_addr learned my addr 172.21.15.167:0/2474918588 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaeffd640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb0143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdae7fc640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb0070bb0 0x7efdb0136e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaf7fe640 1 -- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 msgr2=0x7efdb0143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaf7fe640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb0143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaf7fe640 1 -- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb0070bb0 msgr2=0x7efdb0136e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaf7fe640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb0070bb0 0x7efdb0136e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaf7fe640 1 -- 172.21.15.167:0/2474918588 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8009420 con 0x7efdb0070ff0 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaeffd640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb0143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaf7fe640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb0141730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efda80097f0 tx=0x7efda801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efda77fe640 1 -- 172.21.15.167:0/2474918588 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80b8650 con 0x7efdb0070ff0 2024-09-13T17:21:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efda77fe640 1 -- 172.21.15.167:0/2474918588 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda80b87b0 con 0x7efdb0070ff0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb01443d0 con 0x7efdb0070ff0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efda77fe640 1 -- 172.21.15.167:0/2474918588 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80b8b40 con 0x7efdb0070ff0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb013ae50 con 0x7efdb0070ff0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb013ab70 con 0x7efdb0070ff0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efda77fe640 1 -- 172.21.15.167:0/2474918588 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efda80b4070 con 0x7efdb0070ff0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efda77fe640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7efd90066690 0x7efd90068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efda77fe640 1 -- 172.21.15.167:0/2474918588 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efda811ee00 con 0x7efdb0070ff0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaeffd640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7efd90066690 0x7efd90068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.338+0000 7efdaeffd640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7efd90066690 0x7efd90068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdb013b2f0 tx=0x7efda0007550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.342+0000 7efda77fe640 1 -- 172.21.15.167:0/2474918588 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efdb013ab70 con 0x7efdb0070ff0 2024-09-13T17:21:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.522+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efdb013ab70 con 0x7efdb0070ff0 2024-09-13T17:21:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.522+0000 7efda77fe640 1 -- 172.21.15.167:0/2474918588 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efdb013ab70 con 0x7efdb0070ff0 2024-09-13T17:21:19.525 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:19.525 INFO:teuthology.orchestra.run.smithi167.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T17:21:19.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.522+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7efd90066690 msgr2=0x7efd90068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.522+0000 7efdb5270640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7efd90066690 0x7efd90068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdb013b2f0 tx=0x7efda0007550 comp rx=0 tx=0).stop 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.522+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 msgr2=0x7efdb0141730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.522+0000 7efdb5270640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb0141730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efda80097f0 tx=0x7efda801abc0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 shutdown_connections 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7efd90066690 0x7efd90068b50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdb0070ff0 0x7efdb0141730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb0070bb0 0x7efdb0136e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 --2- 172.21.15.167:0/2474918588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb006f0f0 0x7efdb0143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 >> 172.21.15.167:0/2474918588 conn(0x7efdb00b7250 msgr2=0x7efdb013bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 shutdown_connections 2024-09-13T17:21:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.526+0000 7efdb5270640 1 -- 172.21.15.167:0/2474918588 wait complete. 2024-09-13T17:21:19.543 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T17:21:19.543 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.646+0000 7f83c6a22640 1 Processor -- start 2024-09-13T17:21:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.646+0000 7f83c6a22640 1 -- start start 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83c6a22640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c00b6450 0x7f83c00b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83c6a22640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00ba8f0 con 0x7f83c00bbdc0 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83c6a22640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00bc1a0 con 0x7f83c0148e80 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83c6a22640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c013ff50 con 0x7f83c00b6450 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f83c00bbdc0 0x7f83c013f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35298/0 (socket says 172.21.15.167:35298) 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bffff640 1 -- 172.21.15.167:0/3481080454 learned_addr learned my addr 172.21.15.167:0/3481080454 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c00b6450 0x7f83c00b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026188151 0 0) 0x7f83c00ba8f0 con 0x7f83c00bbdc0 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ac003530 con 0x7f83c00bbdc0 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503028693 0 0) 0x7f83ac003530 con 0x7f83c00bbdc0 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c00b6450 msgr2=0x7f83c00b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c00b6450 0x7f83c00b9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 >> v1:172.21.15.190:6789/0 conn(0x7f83c0148e80 legacy=0x7f83c0150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00ba2a0 con 0x7f83c00bbdc0 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f83b0001a00 con 0x7f83c00bbdc0 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 >> v1:172.21.15.167:6789/0 conn(0x7f83c00bbdc0 legacy=0x7f83c013f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0039b0 0x7f83ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83ac0047d0 0x7f83ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c00b6450 0x7f83ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c013ff50 con 0x7f83ac0047d0 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac00bac0 con 0x7f83ac0039b0 2024-09-13T17:21:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac00bc80 con 0x7f83c00b6450 2024-09-13T17:21:19.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83ac0047d0 0x7f83ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bffff640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0039b0 0x7f83ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 -- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c00b6450 msgr2=0x7f83ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:19.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c00b6450 0x7f83ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 -- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0039b0 msgr2=0x7f83ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:19.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0039b0 0x7f83ac003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 -- 172.21.15.167:0/3481080454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac003530 con 0x7f83ac0047d0 2024-09-13T17:21:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83bf7fe640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83ac0047d0 0x7f83ac004c50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009ab0 tx=0x7f83a801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b90c164eb07d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a80a5540 con 0x7f83ac0047d0 2024-09-13T17:21:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a80a56a0 con 0x7f83ac0047d0 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83beffd640 1 -- 172.21.15.167:0/3481080454 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a80a5a50 con 0x7f83ac0047d0 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83c6a22640 1 -- 172.21.15.167:0/3481080454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83ac0047d0 msgr2=0x7f83ac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.650+0000 7f83c6a22640 1 --2- 172.21.15.167:0/3481080454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83ac0047d0 0x7f83ac004c50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009ab0 tx=0x7f83a801ca60 comp rx=0 tx=0).stop 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 -- 172.21.15.167:0/3481080454 reap_dead start 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- 172.21.15.167:0/3481080454 shutdown_connections 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- 172.21.15.167:0/3481080454 >> 172.21.15.167:0/3481080454 conn(0x7f83c009d700 msgr2=0x7f83c00bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- 172.21.15.167:0/3481080454 shutdown_connections 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- 172.21.15.167:0/3481080454 wait complete. 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 Processor -- start 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- start start 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0047d0 0x7f83c0099640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c014b7a0 0x7f83c01e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c01e2f60 0x7f83c009af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01e33e0 con 0x7f83c01e2f60 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01e2590 con 0x7f83ac0047d0 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c014bcf0 con 0x7f83c014b7a0 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c01e2f60 0x7f83c009af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c01e2f60 0x7f83c009af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46210/0 (socket says 172.21.15.167:46210) 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 -- 172.21.15.167:0/1021019655 learned_addr learned my addr 172.21.15.167:0/1021019655 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83bffff640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0047d0 0x7f83c0099640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83bf7fe640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c014b7a0 0x7f83c01e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 -- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c014b7a0 msgr2=0x7f83c01e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c014b7a0 0x7f83c01e2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 -- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0047d0 msgr2=0x7f83c0099640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0047d0 0x7f83c0099640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 -- 172.21.15.167:0/1021019655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c009c890 con 0x7f83c01e2f60 2024-09-13T17:21:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c4fbf640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c01e2f60 0x7f83c009af70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f83ac004750 tx=0x7f83b800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83bcff9640 1 -- 172.21.15.167:0/1021019655 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8007480 con 0x7f83c01e2f60 2024-09-13T17:21:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83bcff9640 1 -- 172.21.15.167:0/1021019655 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8007600 con 0x7f83c01e2f60 2024-09-13T17:21:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c009ce50 con 0x7f83c01e2f60 2024-09-13T17:21:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83bcff9640 1 -- 172.21.15.167:0/1021019655 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8005a10 con 0x7f83c01e2f60 2024-09-13T17:21:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c009a2e0 con 0x7f83c01e2f60 2024-09-13T17:21:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c01e2720 con 0x7f83c01e2f60 2024-09-13T17:21:19.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.654+0000 7f83bcff9640 1 -- 172.21.15.167:0/1021019655 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83b8005b70 con 0x7f83c01e2f60 2024-09-13T17:21:19.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.658+0000 7f83bcff9640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f83a00666c0 0x7f83a0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.658+0000 7f83bcff9640 1 -- 172.21.15.167:0/1021019655 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83b8083010 con 0x7f83c01e2f60 2024-09-13T17:21:19.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.658+0000 7f83bffff640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f83a00666c0 0x7f83a0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.658+0000 7f83bffff640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f83a00666c0 0x7f83a0068b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005fd0 tx=0x7f83b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.662+0000 7f83bcff9640 1 -- 172.21.15.167:0/1021019655 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83b8050120 con 0x7f83c01e2f60 2024-09-13T17:21:19.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.806+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c013f840 con 0x7f83c01e2f60 2024-09-13T17:21:19.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83bcff9640 1 -- 172.21.15.167:0/1021019655 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f83b8053740 con 0x7f83c01e2f60 2024-09-13T17:21:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:19.812 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f83a00666c0 msgr2=0x7f83a0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f83a00666c0 0x7f83a0068b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005fd0 tx=0x7f83b0009040 comp rx=0 tx=0).stop 2024-09-13T17:21:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c01e2f60 msgr2=0x7f83c009af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c01e2f60 0x7f83c009af70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f83ac004750 tx=0x7f83b800c820 comp rx=0 tx=0).stop 2024-09-13T17:21:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 shutdown_connections 2024-09-13T17:21:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f83a00666c0 0x7f83a0068b80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c01e2f60 0x7f83c009af70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83c014b7a0 0x7f83c01e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 --2- 172.21.15.167:0/1021019655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83ac0047d0 0x7f83c0099640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 >> 172.21.15.167:0/1021019655 conn(0x7f83c009d700 msgr2=0x7f83c0145900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 shutdown_connections 2024-09-13T17:21:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.810+0000 7f83c6a22640 1 -- 172.21.15.167:0/1021019655 wait complete. 2024-09-13T17:21:19.830 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:20:49.286397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:20:49.932204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:20:52.990224+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:21:19.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:21:19.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.942+0000 7f6b14589640 1 Processor -- start 2024-09-13T17:21:19.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.942+0000 7f6b14589640 1 -- start start 2024-09-13T17:21:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b0c0992d0 0x7f6b0c0ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c142660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6b0c142ba0 0x7f6b0c145600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c0b34c0 con 0x7f6b0c0992d0 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c143050 con 0x7f6b0c142ba0 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0ae2a0 con 0x7f6b0c0996b0 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b0c0992d0 0x7f6b0c0ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b0c0992d0 0x7f6b0c0ac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46220/0 (socket says 172.21.15.167:46220) 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 -- 172.21.15.167:0/2725738298 learned_addr learned my addr 172.21.15.167:0/2725738298 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b11b24640 1 --2- 172.21.15.167:0/2725738298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 -- 172.21.15.167:0/2725738298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 msgr2=0x7f6b0c142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12b26640 1 --2- 172.21.15.167:0/2725738298 >> v2:172.21.15.190:3300/0 conn(0x7f6b0c142ba0 0x7f6b0c145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 --2- 172.21.15.167:0/2725738298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 -- 172.21.15.167:0/2725738298 >> v2:172.21.15.190:3300/0 conn(0x7f6b0c142ba0 msgr2=0x7f6b0c145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 --2- 172.21.15.167:0/2725738298 >> v2:172.21.15.190:3300/0 conn(0x7f6b0c142ba0 0x7f6b0c145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 -- 172.21.15.167:0/2725738298 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c0ad4e0 con 0x7f6b0c0992d0 2024-09-13T17:21:19.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b12325640 1 --2- 172.21.15.167:0/2725738298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c0ac300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c06df70 tx=0x7f6b0801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fb5c64f8f11188 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b11323640 1 -- 172.21.15.167:0/2725738298 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080a5730 con 0x7f6b0c0992d0 2024-09-13T17:21:19.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b11323640 1 -- 172.21.15.167:0/2725738298 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b080a5890 con 0x7f6b0c0992d0 2024-09-13T17:21:19.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b11323640 1 -- 172.21.15.167:0/2725738298 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080a5c20 con 0x7f6b0c0992d0 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 -- 172.21.15.167:0/2725738298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0992d0 msgr2=0x7f6b0c0ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 --2- 172.21.15.167:0/2725738298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c0ac300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c06df70 tx=0x7f6b0801c930 comp rx=0 tx=0).stop 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 -- 172.21.15.167:0/2725738298 shutdown_connections 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 --2- 172.21.15.167:0/2725738298 >> v2:172.21.15.190:3300/0 conn(0x7f6b0c142ba0 0x7f6b0c145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 --2- 172.21.15.167:0/2725738298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 --2- 172.21.15.167:0/2725738298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c0ac300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.946+0000 7f6b14589640 1 -- 172.21.15.167:0/2725738298 >> 172.21.15.167:0/2725738298 conn(0x7f6b0c0b3b50 msgr2=0x7f6b0c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- 172.21.15.167:0/2725738298 shutdown_connections 2024-09-13T17:21:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- 172.21.15.167:0/2725738298 wait complete. 2024-09-13T17:21:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 Processor -- start 2024-09-13T17:21:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- start start 2024-09-13T17:21:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c13fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c1de620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c142ba0 0x7f6b0c1e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c1ddc50 con 0x7f6b0c142ba0 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c14d8c0 con 0x7f6b0c0992d0 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c1de190 con 0x7f6b0c0996b0 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c142ba0 0x7f6b0c1e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c142ba0 0x7f6b0c1e11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46232/0 (socket says 172.21.15.167:46232) 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 -- 172.21.15.167:0/96025429 learned_addr learned my addr 172.21.15.167:0/96025429 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12325640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c13fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b11b24640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c1de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 -- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 msgr2=0x7f6b0c1de620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c1de620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 -- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b0c0992d0 msgr2=0x7f6b0c13fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c13fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 -- 172.21.15.167:0/96025429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b08009b30 con 0x7f6b0c142ba0 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12325640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c13fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b12b26640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c142ba0 0x7f6b0c1e11c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c820 tx=0x7f6b0400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b02ffd640 1 -- 172.21.15.167:0/96025429 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04004220 con 0x7f6b0c142ba0 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b02ffd640 1 -- 172.21.15.167:0/96025429 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04004380 con 0x7f6b0c142ba0 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0c1ddec0 con 0x7f6b0c142ba0 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b02ffd640 1 -- 172.21.15.167:0/96025429 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04007a50 con 0x7f6b0c142ba0 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c1406a0 con 0x7f6b0c142ba0 2024-09-13T17:21:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0c1de340 con 0x7f6b0c142ba0 2024-09-13T17:21:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.950+0000 7f6b02ffd640 1 -- 172.21.15.167:0/96025429 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b04007bb0 con 0x7f6b0c142ba0 2024-09-13T17:21:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.954+0000 7f6b02ffd640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6af0066690 0x7f6af0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.954+0000 7f6b12325640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6af0066690 0x7f6af0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.954+0000 7f6b02ffd640 1 -- 172.21.15.167:0/96025429 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b04083f40 con 0x7f6b0c142ba0 2024-09-13T17:21:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.954+0000 7f6b12325640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6af0066690 0x7f6af0068b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b080a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:19.958+0000 7f6b02ffd640 1 -- 172.21.15.167:0/96025429 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b0c1de340 con 0x7f6b0c142ba0 2024-09-13T17:21:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.102+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b0c1de340 con 0x7f6b0c142ba0 2024-09-13T17:21:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b02ffd640 1 -- 172.21.15.167:0/96025429 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b0c1de340 con 0x7f6b0c142ba0 2024-09-13T17:21:20.108 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:21:20.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6af0066690 msgr2=0x7f6af0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6af0066690 0x7f6af0068b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b080a7070 comp rx=0 tx=0).stop 2024-09-13T17:21:20.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c142ba0 msgr2=0x7f6b0c1e11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c142ba0 0x7f6b0c1e11c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c820 tx=0x7f6b0400cce0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 shutdown_connections 2024-09-13T17:21:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6af0066690 0x7f6af0068b50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c142ba0 0x7f6b0c1e11c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b0c0996b0 0x7f6b0c1de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 --2- 172.21.15.167:0/96025429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b0c0992d0 0x7f6b0c13fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 >> 172.21.15.167:0/96025429 conn(0x7f6b0c0b3b50 msgr2=0x7f6b0c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 shutdown_connections 2024-09-13T17:21:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.106+0000 7f6b14589640 1 -- 172.21.15.167:0/96025429 wait complete. 2024-09-13T17:21:20.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:21:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb2444640 1 Processor -- start 2024-09-13T17:21:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb2444640 1 -- start start 2024-09-13T17:21:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb2444640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8eac065ee0 0x7f8eac149100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb2444640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8eac13fcb0 0x7f8eac149640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb2444640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0662c0 con 0x7f8eac06f840 2024-09-13T17:21:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb2444640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac0705a0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb2444640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac070a80 con 0x7f8eac065ee0 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb09e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8eac13fcb0 0x7f8eac149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb09e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8eac13fcb0 0x7f8eac149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46234/0 (socket says 172.21.15.167:46234) 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb09e1640 1 -- 172.21.15.167:0/1632239858 learned_addr learned my addr 172.21.15.167:0/1632239858 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eabfff640 1 --2- 172.21.15.167:0/1632239858 >> v2:172.21.15.190:3300/0 conn(0x7f8eac065ee0 0x7f8eac149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb09e1640 1 -- 172.21.15.167:0/1632239858 >> v2:172.21.15.190:3300/0 conn(0x7f8eac065ee0 msgr2=0x7f8eac149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb09e1640 1 --2- 172.21.15.167:0/1632239858 >> v2:172.21.15.190:3300/0 conn(0x7f8eac065ee0 0x7f8eac149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb09e1640 1 -- 172.21.15.167:0/1632239858 >> v1:172.21.15.190:6789/0 conn(0x7f8eac06f840 legacy=0x7f8eac13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:20.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.246+0000 7f8eb09e1640 1 -- 172.21.15.167:0/1632239858 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac071380 con 0x7f8eac13fcb0 2024-09-13T17:21:20.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 --2- 172.21.15.167:0/1632239858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac149640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009870 tx=0x7f8ea401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa049e34a268102 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eaaffd640 1 -- 172.21.15.167:0/1632239858 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40ab650 con 0x7f8eac13fcb0 2024-09-13T17:21:20.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eaaffd640 1 -- 172.21.15.167:0/1632239858 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40ab7b0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eaaffd640 1 -- 172.21.15.167:0/1632239858 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40abb40 con 0x7f8eac13fcb0 2024-09-13T17:21:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- 172.21.15.167:0/1632239858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 msgr2=0x7f8eac149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 --2- 172.21.15.167:0/1632239858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac149640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009870 tx=0x7f8ea401c450 comp rx=0 tx=0).stop 2024-09-13T17:21:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- 172.21.15.167:0/1632239858 shutdown_connections 2024-09-13T17:21:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 --2- 172.21.15.167:0/1632239858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac149640 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 --2- 172.21.15.167:0/1632239858 >> v2:172.21.15.190:3300/0 conn(0x7f8eac065ee0 0x7f8eac149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- 172.21.15.167:0/1632239858 >> 172.21.15.167:0/1632239858 conn(0x7f8eac069f80 msgr2=0x7f8eac06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:20.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- 172.21.15.167:0/1632239858 shutdown_connections 2024-09-13T17:21:20.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- 172.21.15.167:0/1632239858 wait complete. 2024-09-13T17:21:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 Processor -- start 2024-09-13T17:21:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- start start 2024-09-13T17:21:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eac065ee0 0x7f8eac0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac06f840 0x7f8eac0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac1dec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac13caf0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac13c850 con 0x7f8eac06f840 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb2444640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1de460 con 0x7f8eac065ee0 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac1dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac1dec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46246/0 (socket says 172.21.15.167:46246) 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 -- 172.21.15.167:0/579892216 learned_addr learned my addr 172.21.15.167:0/579892216 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eabfff640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eac065ee0 0x7f8eac0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eab7fe640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac06f840 0x7f8eac0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 -- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eac065ee0 msgr2=0x7f8eac0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eac065ee0 0x7f8eac0b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 -- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac06f840 msgr2=0x7f8eac0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac06f840 0x7f8eac0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.250+0000 7f8eb09e1640 1 -- 172.21.15.167:0/579892216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40094d0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8eb09e1640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac1dec60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ad040 tx=0x7f8ea401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8ea8ff9640 1 -- 172.21.15.167:0/579892216 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40b4800 con 0x7f8eac13fcb0 2024-09-13T17:21:20.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8ea8ff9640 1 -- 172.21.15.167:0/579892216 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40b4960 con 0x7f8eac13fcb0 2024-09-13T17:21:20.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac1de740 con 0x7f8eac13fcb0 2024-09-13T17:21:20.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8ea8ff9640 1 -- 172.21.15.167:0/579892216 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40b4d10 con 0x7f8eac13fcb0 2024-09-13T17:21:20.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac1df1a0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac1de2c0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8ea8ff9640 1 -- 172.21.15.167:0/579892216 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ea40c7440 con 0x7f8eac13fcb0 2024-09-13T17:21:20.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8ea8ff9640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8e8c066690 0x7f8e8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8ea8ff9640 1 -- 172.21.15.167:0/579892216 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ea411eff0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8eabfff640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8e8c066690 0x7f8e8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.254+0000 7f8eabfff640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8e8c066690 0x7f8e8c068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c003fd0 tx=0x7f8e9c0039a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.258+0000 7f8ea8ff9640 1 -- 172.21.15.167:0/579892216 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8eac1de2c0 con 0x7f8eac13fcb0 2024-09-13T17:21:20.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.410+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8eac1de980 con 0x7f8eac13fcb0 2024-09-13T17:21:20.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.410+0000 7f8ea8ff9640 1 -- 172.21.15.167:0/579892216 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8eac1de980 con 0x7f8eac13fcb0 2024-09-13T17:21:20.414 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:20.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8e8c066690 msgr2=0x7f8e8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8e8c066690 0x7f8e8c068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c003fd0 tx=0x7f8e9c0039a0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 msgr2=0x7f8eac1dec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac1dec60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ad040 tx=0x7f8ea401ac90 comp rx=0 tx=0).stop 2024-09-13T17:21:20.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 shutdown_connections 2024-09-13T17:21:20.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8e8c066690 0x7f8e8c068b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac13fcb0 0x7f8eac1dec60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac06f840 0x7f8eac0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 --2- 172.21.15.167:0/579892216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eac065ee0 0x7f8eac0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 >> 172.21.15.167:0/579892216 conn(0x7f8eac069f80 msgr2=0x7f8eac0b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 shutdown_connections 2024-09-13T17:21:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.414+0000 7f8eb2444640 1 -- 172.21.15.167:0/579892216 wait complete. 2024-09-13T17:21:20.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:21:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.546+0000 7f5f6e05d640 1 Processor -- start 2024-09-13T17:21:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.546+0000 7f5f6e05d640 1 -- start start 2024-09-13T17:21:20.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f680b3230 0x7f5f680b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5f68098a40 0x7f5f68098e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f68147010 0x7f5f681474c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680ac070 con 0x7f5f680b3230 2024-09-13T17:21:20.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680ae210 con 0x7f5f68098a40 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680acfc0 con 0x7f5f68147010 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f680b3230 0x7f5f680b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f680b3230 0x7f5f680b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46254/0 (socket says 172.21.15.167:46254) 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 -- 172.21.15.167:0/3641158398 learned_addr learned my addr 172.21.15.167:0/3641158398 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f66ffd640 1 --2- 172.21.15.167:0/3641158398 >> v2:172.21.15.190:3300/0 conn(0x7f5f68098a40 0x7f5f68098e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f67fff640 1 --2- 172.21.15.167:0/3641158398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f68147010 0x7f5f681474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 -- 172.21.15.167:0/3641158398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f68147010 msgr2=0x7f5f681474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 --2- 172.21.15.167:0/3641158398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f68147010 0x7f5f681474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 -- 172.21.15.167:0/3641158398 >> v2:172.21.15.190:3300/0 conn(0x7f5f68098a40 msgr2=0x7f5f68098e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 --2- 172.21.15.167:0/3641158398 >> v2:172.21.15.190:3300/0 conn(0x7f5f68098a40 0x7f5f68098e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 -- 172.21.15.167:0/3641158398 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680ad730 con 0x7f5f680b3230 2024-09-13T17:21:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f66ffd640 1 --2- 172.21.15.167:0/3641158398 >> v2:172.21.15.190:3300/0 conn(0x7f5f68098a40 0x7f5f68098e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f677fe640 1 --2- 172.21.15.167:0/3641158398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f680b3230 0x7f5f680b3610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806d050 tx=0x7f5f6001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bf0860b8827248 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f667fc640 1 -- 172.21.15.167:0/3641158398 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600a5640 con 0x7f5f680b3230 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f667fc640 1 -- 172.21.15.167:0/3641158398 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f600a57a0 con 0x7f5f680b3230 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f667fc640 1 -- 172.21.15.167:0/3641158398 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600a5b30 con 0x7f5f680b3230 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- 172.21.15.167:0/3641158398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f680b3230 msgr2=0x7f5f680b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/3641158398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f680b3230 0x7f5f680b3610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806d050 tx=0x7f5f6001c8d0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- 172.21.15.167:0/3641158398 shutdown_connections 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/3641158398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f68147010 0x7f5f681474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/3641158398 >> v2:172.21.15.190:3300/0 conn(0x7f5f68098a40 0x7f5f68098e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/3641158398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f680b3230 0x7f5f680b3610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- 172.21.15.167:0/3641158398 >> 172.21.15.167:0/3641158398 conn(0x7f5f680b3b50 msgr2=0x7f5f680b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- 172.21.15.167:0/3641158398 shutdown_connections 2024-09-13T17:21:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.550+0000 7f5f6e05d640 1 -- 172.21.15.167:0/3641158398 wait complete. 2024-09-13T17:21:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 Processor -- start 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 -- start start 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f68098a40 0x7f5f681e5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f680b3230 0x7f5f680b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f68147010 0x7f5f68148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681e6690 con 0x7f5f68098a40 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681e5e90 con 0x7f5f68147010 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680b1090 con 0x7f5f680b3230 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f68098a40 0x7f5f681e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f68098a40 0x7f5f681e5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46258/0 (socket says 172.21.15.167:46258) 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 -- 172.21.15.167:0/2565606832 learned_addr learned my addr 172.21.15.167:0/2565606832 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f66ffd640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f680b3230 0x7f5f680b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f67fff640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f68147010 0x7f5f68148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 -- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f680b3230 msgr2=0x7f5f680b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f680b3230 0x7f5f680b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 -- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f68147010 msgr2=0x7f5f68148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f68147010 0x7f5f68148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 -- 172.21.15.167:0/2565606832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f60009b30 con 0x7f5f68098a40 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f677fe640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f68098a40 0x7f5f681e5950 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f600af040 tx=0x7f5f60019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f5ffff640 1 -- 172.21.15.167:0/2565606832 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600b8670 con 0x7f5f68098a40 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f5ffff640 1 -- 172.21.15.167:0/2565606832 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f600b8810 con 0x7f5f68098a40 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f5ffff640 1 -- 172.21.15.167:0/2565606832 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600b8bc0 con 0x7f5f68098a40 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6809a570 con 0x7f5f68098a40 2024-09-13T17:21:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6814a590 con 0x7f5f68098a40 2024-09-13T17:21:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6814e1a0 con 0x7f5f68098a40 2024-09-13T17:21:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.554+0000 7f5f5ffff640 1 -- 172.21.15.167:0/2565606832 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f600b8d20 con 0x7f5f68098a40 2024-09-13T17:21:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.558+0000 7f5f5ffff640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5f48066690 0x7f5f48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.558+0000 7f5f5ffff640 1 -- 172.21.15.167:0/2565606832 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f6011fc70 con 0x7f5f68098a40 2024-09-13T17:21:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.558+0000 7f5f66ffd640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5f48066690 0x7f5f48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.558+0000 7f5f66ffd640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5f48066690 0x7f5f48068b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806d050 tx=0x7f5f58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.562+0000 7f5f5ffff640 1 -- 172.21.15.167:0/2565606832 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f600ecea0 con 0x7f5f68098a40 2024-09-13T17:21:20.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f680b50a0 con 0x7f5f68098a40 2024-09-13T17:21:20.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f5ffff640 1 -- 172.21.15.167:0/2565606832 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f600f04c0 con 0x7f5f68098a40 2024-09-13T17:21:20.720 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5f48066690 msgr2=0x7f5f48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5f48066690 0x7f5f48068b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806d050 tx=0x7f5f58008040 comp rx=0 tx=0).stop 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f68098a40 msgr2=0x7f5f681e5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f68098a40 0x7f5f681e5950 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f600af040 tx=0x7f5f60019670 comp rx=0 tx=0).stop 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 shutdown_connections 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5f48066690 0x7f5f48068b50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f68147010 0x7f5f68148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f680b3230 0x7f5f680b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 --2- 172.21.15.167:0/2565606832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f68098a40 0x7f5f681e5950 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 >> 172.21.15.167:0/2565606832 conn(0x7f5f680b3b50 msgr2=0x7f5f6814cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:20.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 shutdown_connections 2024-09-13T17:21:20.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.718+0000 7f5f6e05d640 1 -- 172.21.15.167:0/2565606832 wait complete. 2024-09-13T17:21:20.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:21:20.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75afef5640 1 Processor -- start 2024-09-13T17:21:20.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75afef5640 1 -- start start 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75afef5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80b3530 0x7f75a809cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75afef5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75a81441b0 0x7f75a814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75afef5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a80b3910 con 0x7f75a8098a40 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75afef5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a809b090 con 0x7f75a81441b0 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75afef5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8099490 con 0x7f75a80b3530 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ae492640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75a81441b0 0x7f75a814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ad490640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f75a8098a40 0x7f75a8143aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35314/0 (socket says 172.21.15.167:35314) 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ad490640 1 -- 172.21.15.167:0/1324849748 learned_addr learned my addr 172.21.15.167:0/1324849748 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75adc91640 1 --2- 172.21.15.167:0/1324849748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80b3530 0x7f75a809cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ae492640 1 -- 172.21.15.167:0/1324849748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80b3530 msgr2=0x7f75a809cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:20.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ae492640 1 --2- 172.21.15.167:0/1324849748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80b3530 0x7f75a809cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ae492640 1 -- 172.21.15.167:0/1324849748 >> v1:172.21.15.167:6789/0 conn(0x7f75a8098a40 legacy=0x7f75a8143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ae492640 1 -- 172.21.15.167:0/1324849748 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8098ed0 con 0x7f75a81441b0 2024-09-13T17:21:20.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75acc8f640 1 -- 172.21.15.167:0/1324849748 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48886969 0 0) 0x7f75a80b3910 con 0x7f75a8098a40 2024-09-13T17:21:20.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75ae492640 1 --2- 172.21.15.167:0/1324849748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a81441b0 0x7f75a814dff0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009d90 tx=0x7f75a001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb765970dffe0edb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75acc8f640 1 -- 172.21.15.167:0/1324849748 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a00a5a20 con 0x7f75a81441b0 2024-09-13T17:21:20.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75acc8f640 1 -- 172.21.15.167:0/1324849748 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a00a5b80 con 0x7f75a81441b0 2024-09-13T17:21:20.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.858+0000 7f75acc8f640 1 -- 172.21.15.167:0/1324849748 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a00ad440 con 0x7f75a81441b0 2024-09-13T17:21:20.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1324849748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a81441b0 msgr2=0x7f75a814dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 --2- 172.21.15.167:0/1324849748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a81441b0 0x7f75a814dff0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009d90 tx=0x7f75a001c940 comp rx=0 tx=0).stop 2024-09-13T17:21:20.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1324849748 shutdown_connections 2024-09-13T17:21:20.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 --2- 172.21.15.167:0/1324849748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a81441b0 0x7f75a814dff0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 --2- 172.21.15.167:0/1324849748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80b3530 0x7f75a809cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1324849748 >> 172.21.15.167:0/1324849748 conn(0x7f75a80b3b50 msgr2=0x7f75a80b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:20.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1324849748 shutdown_connections 2024-09-13T17:21:20.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1324849748 wait complete. 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 Processor -- start 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- start start 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a80b3530 0x7f75a80acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a81441b0 0x7f75a813fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80adbe0 0x7f75a814c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81410f0 con 0x7f75a80b3530 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80ad530 con 0x7f75a81441b0 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80ac730 con 0x7f75a80adbe0 2024-09-13T17:21:20.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a80b3530 0x7f75a80acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a80b3530 0x7f75a80acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46286/0 (socket says 172.21.15.167:46286) 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 -- 172.21.15.167:0/1878359699 learned_addr learned my addr 172.21.15.167:0/1878359699 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 -- 172.21.15.167:0/1878359699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80adbe0 msgr2=0x7f75a814c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80adbe0 0x7f75a814c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 -- 172.21.15.167:0/1878359699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a81441b0 msgr2=0x7f75a813fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a81441b0 0x7f75a813fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 -- 172.21.15.167:0/1878359699 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009a70 con 0x7f75a80b3530 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75adc91640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a80b3530 0x7f75a80acff0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75a400d800 tx=0x7f75a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f759e7fc640 1 -- 172.21.15.167:0/1878359699 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400b6c0 con 0x7f75a80b3530 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f759e7fc640 1 -- 172.21.15.167:0/1878359699 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400b860 con 0x7f75a80b3530 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a8140e10 con 0x7f75a80b3530 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f759e7fc640 1 -- 172.21.15.167:0/1878359699 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400bc10 con 0x7f75a80b3530 2024-09-13T17:21:20.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a81448f0 con 0x7f75a80b3530 2024-09-13T17:21:20.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.862+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a80ac450 con 0x7f75a80b3530 2024-09-13T17:21:20.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.866+0000 7f759e7fc640 1 -- 172.21.15.167:0/1878359699 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75a401e460 con 0x7f75a80b3530 2024-09-13T17:21:20.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.866+0000 7f759e7fc640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f758c066690 0x7f758c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:20.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.866+0000 7f759e7fc640 1 -- 172.21.15.167:0/1878359699 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75a4084a30 con 0x7f75a80b3530 2024-09-13T17:21:20.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.866+0000 7f75ad490640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f758c066690 0x7f758c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:20.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.866+0000 7f75ad490640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f758c066690 0x7f758c068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75980011f0 tx=0x7f7598007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:20.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:20.870+0000 7f759e7fc640 1 -- 172.21.15.167:0/1878359699 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75a80ac450 con 0x7f75a80b3530 2024-09-13T17:21:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.014+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f75a80ac450 con 0x7f75a80b3530 2024-09-13T17:21:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.014+0000 7f759e7fc640 1 -- 172.21.15.167:0/1878359699 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f75a80ac450 con 0x7f75a80b3530 2024-09-13T17:21:21.019 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:21.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f758c066690 msgr2=0x7f758c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f758c066690 0x7f758c068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75980011f0 tx=0x7f7598007930 comp rx=0 tx=0).stop 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a80b3530 msgr2=0x7f75a80acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a80b3530 0x7f75a80acff0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75a400d800 tx=0x7f75a400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 shutdown_connections 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f758c066690 0x7f758c068b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a80adbe0 0x7f75a814c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a81441b0 0x7f75a813fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 --2- 172.21.15.167:0/1878359699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a80b3530 0x7f75a80acff0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 >> 172.21.15.167:0/1878359699 conn(0x7f75a80b3b50 msgr2=0x7f75a80b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 shutdown_connections 2024-09-13T17:21:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.018+0000 7f75afef5640 1 -- 172.21.15.167:0/1878359699 wait complete. 2024-09-13T17:21:21.037 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:21:21.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.142+0000 7fda05f6a640 1 Processor -- start 2024-09-13T17:21:21.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.142+0000 7fda05f6a640 1 -- start start 2024-09-13T17:21:21.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.142+0000 7fda05f6a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fda0006bde0 0x7fda000b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fda05f6a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda000a0b60 0x7fda001502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fda05f6a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0006c1c0 con 0x7fda000b6690 2024-09-13T17:21:21.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fda05f6a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda00146950 con 0x7fda0006bde0 2024-09-13T17:21:21.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fda05f6a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0006b380 con 0x7fda000a0b60 2024-09-13T17:21:21.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda000a0b60 0x7fda001502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9ff7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fda0006bde0 0x7fda000b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda000a0b60 0x7fda001502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.167:37070/0 (socket says 172.21.15.167:37070) 2024-09-13T17:21:21.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 -- 172.21.15.167:0/1533849419 learned_addr learned my addr 172.21.15.167:0/1533849419 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:21.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 -- 172.21.15.167:0/1533849419 >> v2:172.21.15.190:3300/0 conn(0x7fda0006bde0 msgr2=0x7fda000b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:21.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 --2- 172.21.15.167:0/1533849419 >> v2:172.21.15.190:3300/0 conn(0x7fda0006bde0 0x7fda000b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 -- 172.21.15.167:0/1533849419 >> v1:172.21.15.190:6789/0 conn(0x7fda000b6690 legacy=0x7fda000a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 -- 172.21.15.167:0/1533849419 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00145e70 con 0x7fda000a0b60 2024-09-13T17:21:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9fffff640 1 --2- 172.21.15.167:0/1533849419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda000a0b60 0x7fda001502c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009e50 tx=0x7fd9f801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17c2d9b813bc7136 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9feffd640 1 -- 172.21.15.167:0/1533849419 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80a5740 con 0x7fda000a0b60 2024-09-13T17:21:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9feffd640 1 -- 172.21.15.167:0/1533849419 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f80a58a0 con 0x7fda000a0b60 2024-09-13T17:21:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.146+0000 7fd9feffd640 1 -- 172.21.15.167:0/1533849419 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80a5c30 con 0x7fda000a0b60 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- 172.21.15.167:0/1533849419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda000a0b60 msgr2=0x7fda001502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 --2- 172.21.15.167:0/1533849419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda000a0b60 0x7fda001502c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009e50 tx=0x7fd9f801c970 comp rx=0 tx=0).stop 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- 172.21.15.167:0/1533849419 shutdown_connections 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 --2- 172.21.15.167:0/1533849419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda000a0b60 0x7fda001502c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 --2- 172.21.15.167:0/1533849419 >> v2:172.21.15.190:3300/0 conn(0x7fda0006bde0 0x7fda000b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- 172.21.15.167:0/1533849419 >> 172.21.15.167:0/1533849419 conn(0x7fda000b7e80 msgr2=0x7fda000b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- 172.21.15.167:0/1533849419 shutdown_connections 2024-09-13T17:21:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- 172.21.15.167:0/1533849419 wait complete. 2024-09-13T17:21:21.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 Processor -- start 2024-09-13T17:21:21.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- start start 2024-09-13T17:21:21.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda0006bde0 0x7fda0009b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda000a0b60 0x7fda001e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda000b6690 0x7fda001e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0013a290 con 0x7fda000b6690 2024-09-13T17:21:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda00140bf0 con 0x7fda000a0b60 2024-09-13T17:21:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fda05f6a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda00142d10 con 0x7fda0006bde0 2024-09-13T17:21:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda000b6690 0x7fda001e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda000b6690 0x7fda001e2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46300/0 (socket says 172.21.15.167:46300) 2024-09-13T17:21:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9ff7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda0006bde0 0x7fda0009b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 -- 172.21.15.167:0/4146681138 learned_addr learned my addr 172.21.15.167:0/4146681138 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9f7fff640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda000a0b60 0x7fda001e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 -- 172.21.15.167:0/4146681138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda0006bde0 msgr2=0x7fda0009b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda0006bde0 0x7fda0009b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 -- 172.21.15.167:0/4146681138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda000a0b60 msgr2=0x7fda001e25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda000a0b60 0x7fda001e25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 -- 172.21.15.167:0/4146681138 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8009b30 con 0x7fda000b6690 2024-09-13T17:21:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.150+0000 7fd9fffff640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda000b6690 0x7fda001e2b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd9f801a5a0 tx=0x7fd9f8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9fcff9640 1 -- 172.21.15.167:0/4146681138 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80b8670 con 0x7fda000b6690 2024-09-13T17:21:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9fcff9640 1 -- 172.21.15.167:0/4146681138 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f80b87d0 con 0x7fda000b6690 2024-09-13T17:21:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda000a03b0 con 0x7fda000b6690 2024-09-13T17:21:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9fcff9640 1 -- 172.21.15.167:0/4146681138 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80b8b40 con 0x7fda000b6690 2024-09-13T17:21:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda00140910 con 0x7fda000b6690 2024-09-13T17:21:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda000b6150 con 0x7fda000b6690 2024-09-13T17:21:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9fcff9640 1 -- 172.21.15.167:0/4146681138 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9f80b8ca0 con 0x7fda000b6690 2024-09-13T17:21:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9fcff9640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd9e00666c0 0x7fd9e0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9fcff9640 1 -- 172.21.15.167:0/4146681138 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9f811f9c0 con 0x7fda000b6690 2024-09-13T17:21:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9ff7fe640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd9e00666c0 0x7fd9e0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.154+0000 7fd9ff7fe640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd9e00666c0 0x7fd9e0068b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009b60 tx=0x7fd9f0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.158+0000 7fd9fcff9640 1 -- 172.21.15.167:0/4146681138 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9f80ecb80 con 0x7fda000b6690 2024-09-13T17:21:21.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.334+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda000b74b0 con 0x7fda000b6690 2024-09-13T17:21:21.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fd9fcff9640 1 -- 172.21.15.167:0/4146681138 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3221 (secure 0 0 0) 0x7fd9f80f01a0 con 0x7fda000b6690 2024-09-13T17:21:21.340 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:21:13.609389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:21:21.340 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 8 2024-09-13T17:21:21.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd9e00666c0 msgr2=0x7fd9e0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd9e00666c0 0x7fd9e0068b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009b60 tx=0x7fd9f0009190 comp rx=0 tx=0).stop 2024-09-13T17:21:21.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda000b6690 msgr2=0x7fda001e2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda000b6690 0x7fda001e2b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd9f801a5a0 tx=0x7fd9f8019710 comp rx=0 tx=0).stop 2024-09-13T17:21:21.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 shutdown_connections 2024-09-13T17:21:21.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd9e00666c0 0x7fd9e0068b80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda000b6690 0x7fda001e2b30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda000a0b60 0x7fda001e25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 --2- 172.21.15.167:0/4146681138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda0006bde0 0x7fda0009b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 >> 172.21.15.167:0/4146681138 conn(0x7fda000b7e80 msgr2=0x7fda00144230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:21.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 shutdown_connections 2024-09-13T17:21:21.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.338+0000 7fda05f6a640 1 -- 172.21.15.167:0/4146681138 wait complete. 2024-09-13T17:21:21.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:21.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.458+0000 7f4876714640 1 Processor -- start 2024-09-13T17:21:21.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f4876714640 1 -- start start 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f4876714640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f487006f0f0 0x7f48700b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f4876714640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4870070bb0 0x7f487013d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f4876714640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4870071b10 con 0x7f487013ddf0 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f4876714640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487006f7f0 con 0x7f487006f0f0 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f4876714640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700b0ea0 con 0x7f4870070bb0 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f487006f0f0 0x7f48700b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f487006f0f0 0x7f48700b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46306/0 (socket says 172.21.15.167:46306) 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 -- 172.21.15.167:0/2554225492 learned_addr learned my addr 172.21.15.167:0/2554225492 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 -- 172.21.15.167:0/2554225492 >> v2:172.21.15.190:3300/0 conn(0x7f4870070bb0 msgr2=0x7f487013d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f48677fe640 1 --2- 172.21.15.167:0/2554225492 >> v2:172.21.15.190:3300/0 conn(0x7f4870070bb0 0x7f487013d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 --2- 172.21.15.167:0/2554225492 >> v2:172.21.15.190:3300/0 conn(0x7f4870070bb0 0x7f487013d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 -- 172.21.15.167:0/2554225492 >> v1:172.21.15.190:6789/0 conn(0x7f487013ddf0 legacy=0x7f4870146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 -- 172.21.15.167:0/2554225492 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4870071df0 con 0x7f487006f0f0 2024-09-13T17:21:21.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486ffff640 1 --2- 172.21.15.167:0/2554225492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f48700b0960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4870147ef0 tx=0x7f485801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ddcf9fdd5ea66c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486f7fe640 1 -- 172.21.15.167:0/2554225492 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580ac620 con 0x7f487006f0f0 2024-09-13T17:21:21.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486f7fe640 1 -- 172.21.15.167:0/2554225492 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48580ac780 con 0x7f487006f0f0 2024-09-13T17:21:21.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.462+0000 7f486f7fe640 1 -- 172.21.15.167:0/2554225492 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580acb10 con 0x7f487006f0f0 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/2554225492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 msgr2=0x7f48700b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 --2- 172.21.15.167:0/2554225492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f48700b0960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4870147ef0 tx=0x7f485801c3c0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/2554225492 shutdown_connections 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 --2- 172.21.15.167:0/2554225492 >> v2:172.21.15.190:3300/0 conn(0x7f4870070bb0 0x7f487013d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 --2- 172.21.15.167:0/2554225492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f48700b0960 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/2554225492 >> 172.21.15.167:0/2554225492 conn(0x7f48700b7250 msgr2=0x7f48700b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/2554225492 shutdown_connections 2024-09-13T17:21:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/2554225492 wait complete. 2024-09-13T17:21:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 Processor -- start 2024-09-13T17:21:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- start start 2024-09-13T17:21:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f4870142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4870070bb0 0x7f48701dc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f487013ddf0 0x7f4870140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870141be0 con 0x7f487006f0f0 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870141730 con 0x7f4870070bb0 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870141df0 con 0x7f487013ddf0 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f4870142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f4870142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46322/0 (socket says 172.21.15.167:46322) 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 -- 172.21.15.167:0/3237003971 learned_addr learned my addr 172.21.15.167:0/3237003971 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f48677fe640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4870070bb0 0x7f48701dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4874cb1640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f487013ddf0 0x7f4870140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 -- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f487013ddf0 msgr2=0x7f4870140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f487013ddf0 0x7f4870140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 -- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4870070bb0 msgr2=0x7f48701dc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4870070bb0 0x7f48701dc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 -- 172.21.15.167:0/3237003971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580094d0 con 0x7f487006f0f0 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f48677fe640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4870070bb0 0x7f48701dc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486ffff640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f4870142bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f48580af040 tx=0x7f485801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486d7fa640 1 -- 172.21.15.167:0/3237003971 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580b7830 con 0x7f487006f0f0 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486d7fa640 1 -- 172.21.15.167:0/3237003971 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48580b79b0 con 0x7f487006f0f0 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f486d7fa640 1 -- 172.21.15.167:0/3237003971 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580b7d60 con 0x7f487006f0f0 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4870072400 con 0x7f487006f0f0 2024-09-13T17:21:21.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48701428d0 con 0x7f487006f0f0 2024-09-13T17:21:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.466+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700b0960 con 0x7f487006f0f0 2024-09-13T17:21:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.470+0000 7f486d7fa640 1 -- 172.21.15.167:0/3237003971 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48580b3040 con 0x7f487006f0f0 2024-09-13T17:21:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.470+0000 7f486d7fa640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f48500666c0 0x7f4850068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.470+0000 7f48677fe640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f48500666c0 0x7f4850068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.470+0000 7f486d7fa640 1 -- 172.21.15.167:0/3237003971 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f485811eb10 con 0x7f487006f0f0 2024-09-13T17:21:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.470+0000 7f48677fe640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f48500666c0 0x7f4850068b80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4870137d80 tx=0x7f4860008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.474+0000 7f486d7fa640 1 -- 172.21.15.167:0/3237003971 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48580ebc20 con 0x7f487006f0f0 2024-09-13T17:21:21.485 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:21:21.486 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:21:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.622+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4870142190 con 0x7f487006f0f0 2024-09-13T17:21:21.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f486d7fa640 1 -- 172.21.15.167:0/3237003971 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f485811e020 con 0x7f487006f0f0 2024-09-13T17:21:21.628 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:21.628 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f48500666c0 msgr2=0x7f4850068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f48500666c0 0x7f4850068b80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4870137d80 tx=0x7f4860008040 comp rx=0 tx=0).stop 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 msgr2=0x7f4870142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f4870142bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f48580af040 tx=0x7f485801ac00 comp rx=0 tx=0).stop 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 shutdown_connections 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f48500666c0 0x7f4850068b80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f487013ddf0 0x7f4870140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4870070bb0 0x7f48701dc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 --2- 172.21.15.167:0/3237003971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487006f0f0 0x7f4870142bc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 >> 172.21.15.167:0/3237003971 conn(0x7f48700b7250 msgr2=0x7f487013c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:21.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 shutdown_connections 2024-09-13T17:21:21.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.626+0000 7f4876714640 1 -- 172.21.15.167:0/3237003971 wait complete. 2024-09-13T17:21:21.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:20:49.286397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:20:49.932204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:20:52.990224+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:21:21.646 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:21:21.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.762+0000 7f7a8c3d0640 1 Processor -- start 2024-09-13T17:21:21.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.762+0000 7f7a8c3d0640 1 -- start start 2024-09-13T17:21:21.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8c3d0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7a841441b0 0x7f7a8414f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8c3d0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8409d410 con 0x7f7a840b3530 2024-09-13T17:21:21.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8c3d0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a840b3910 con 0x7f7a84098a40 2024-09-13T17:21:21.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8c3d0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8409b090 con 0x7f7a841441b0 2024-09-13T17:21:21.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7a840b3530 0x7f7a8409cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35322/0 (socket says 172.21.15.167:35322) 2024-09-13T17:21:21.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 -- 172.21.15.167:0/3703977652 learned_addr learned my addr 172.21.15.167:0/3703977652 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a96d640 1 --2- 172.21.15.167:0/3703977652 >> v2:172.21.15.190:3300/0 conn(0x7f7a841441b0 0x7f7a8414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752569490 0 0) 0x7f7a8409d410 con 0x7f7a840b3530 2024-09-13T17:21:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a70003530 con 0x7f7a840b3530 2024-09-13T17:21:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204466703 0 0) 0x7f7a70003530 con 0x7f7a840b3530 2024-09-13T17:21:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 >> v2:172.21.15.190:3300/0 conn(0x7f7a841441b0 msgr2=0x7f7a8414f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 --2- 172.21.15.167:0/3703977652 >> v2:172.21.15.190:3300/0 conn(0x7f7a841441b0 0x7f7a8414f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 >> v1:172.21.15.190:6789/0 conn(0x7f7a84098a40 legacy=0x7f7a84143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a84099490 con 0x7f7a840b3530 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f7a80001680 con 0x7f7a840b3530 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 >> v1:172.21.15.167:6789/0 conn(0x7f7a840b3530 legacy=0x7f7a8409cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a70003980 0x7f7a70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a700047d0 0x7f7a70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a70005190 0x7f7a7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8409b090 con 0x7f7a70003980 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7000c030 con 0x7f7a700047d0 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7000c1f0 con 0x7f7a70005190 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a70003980 0x7f7a70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 -- 172.21.15.167:0/3703977652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a70005190 msgr2=0x7f7a7000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a70005190 0x7f7a7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 -- 172.21.15.167:0/3703977652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a700047d0 msgr2=0x7f7a70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:21.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a700047d0 0x7f7a70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a16c640 1 -- 172.21.15.167:0/3703977652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70003530 con 0x7f7a70003980 2024-09-13T17:21:21.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.766+0000 7f7a8a96d640 1 -- 172.21.15.167:0/3703977652 reap_dead start 2024-09-13T17:21:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a70003980 0x7f7a70003da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c240 tx=0x7f7a8001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313dbc4c5334496c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80005ae0 con 0x7f7a70003980 2024-09-13T17:21:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80005c40 con 0x7f7a70003980 2024-09-13T17:21:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8916a640 1 -- 172.21.15.167:0/3703977652 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800a58d0 con 0x7f7a70003980 2024-09-13T17:21:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3703977652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a70003980 msgr2=0x7f7a70003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a70003980 0x7f7a70003da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c240 tx=0x7f7a8001cbb0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3703977652 shutdown_connections 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3703977652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a70003980 0x7f7a70003da0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3703977652 >> 172.21.15.167:0/3703977652 conn(0x7f7a840b3b50 msgr2=0x7f7a840b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3703977652 shutdown_connections 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3703977652 wait complete. 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 Processor -- start 2024-09-13T17:21:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- start start 2024-09-13T17:21:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a70003980 0x7f7a841400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a84140d30 0x7f7a841de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8413e930 0x7f7a8413ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8413fca0 con 0x7f7a8413e930 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a841df1a0 con 0x7f7a70003980 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a841de700 con 0x7f7a84140d30 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8413e930 0x7f7a8413ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8413e930 0x7f7a8413ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46340/0 (socket says 172.21.15.167:46340) 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 -- 172.21.15.167:0/3503516528 learned_addr learned my addr 172.21.15.167:0/3503516528 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a70003980 0x7f7a841400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8996b640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a84140d30 0x7f7a841de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 -- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a84140d30 msgr2=0x7f7a841de1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a84140d30 0x7f7a841de1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 -- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a70003980 msgr2=0x7f7a841400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a70003980 0x7f7a841400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 -- 172.21.15.167:0/3503516528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8413f320 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a70003980 0x7f7a841400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8996b640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a84140d30 0x7f7a841de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8a96d640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8413e930 0x7f7a8413ed90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a84072150 tx=0x7f7a7c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a7affd640 1 -- 172.21.15.167:0/3503516528 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c010040 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a7affd640 1 -- 172.21.15.167:0/3503516528 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00bb40 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8413f570 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a7affd640 1 -- 172.21.15.167:0/3503516528 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c014400 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.770+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a84070b80 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.774+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8413fde0 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.774+0000 7f7a7affd640 1 -- 172.21.15.167:0/3503516528 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a7c014560 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.774+0000 7f7a7affd640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a680666c0 0x7f7a68068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.774+0000 7f7a7affd640 1 -- 172.21.15.167:0/3503516528 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a7c084980 con 0x7f7a8413e930 2024-09-13T17:21:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.774+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a680666c0 0x7f7a68068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:21.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.774+0000 7f7a8a16c640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a680666c0 0x7f7a68068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a800ab000 tx=0x7f7a800a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.778+0000 7f7a7affd640 1 -- 172.21.15.167:0/3503516528 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a8413fde0 con 0x7f7a8413e930 2024-09-13T17:21:21.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.934+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a8413fde0 con 0x7f7a8413e930 2024-09-13T17:21:21.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a7affd640 1 -- 172.21.15.167:0/3503516528 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a8413fde0 con 0x7f7a8413e930 2024-09-13T17:21:21.940 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:21:21.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a680666c0 msgr2=0x7f7a68068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a680666c0 0x7f7a68068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a800ab000 tx=0x7f7a800a7070 comp rx=0 tx=0).stop 2024-09-13T17:21:21.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8413e930 msgr2=0x7f7a8413ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:21.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8413e930 0x7f7a8413ed90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a84072150 tx=0x7f7a7c00eec0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 shutdown_connections 2024-09-13T17:21:21.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a680666c0 0x7f7a68068b80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8413e930 0x7f7a8413ed90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a84140d30 0x7f7a841de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 --2- 172.21.15.167:0/3503516528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a70003980 0x7f7a841400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:21.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 >> 172.21.15.167:0/3503516528 conn(0x7f7a840b3b50 msgr2=0x7f7a840b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:21.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 shutdown_connections 2024-09-13T17:21:21.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:21.938+0000 7f7a8c3d0640 1 -- 172.21.15.167:0/3503516528 wait complete. 2024-09-13T17:21:21.958 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:21:22.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f3a94f640 1 Processor -- start 2024-09-13T17:21:22.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f3a94f640 1 -- start start 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f3a94f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f340992d0 0x7f9f340ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f3a94f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340ae2a0 con 0x7f9f34142d70 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f3a94f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340ad4e0 con 0x7f9f340996b0 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f3a94f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f340b34c0 con 0x7f9f340992d0 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f33fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f340992d0 0x7f9f340ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f38eec640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9f34142d70 0x7f9f3414c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35328/0 (socket says 172.21.15.167:35328) 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f38eec640 1 -- 172.21.15.167:0/877533918 learned_addr learned my addr 172.21.15.167:0/877533918 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f33fff640 1 -- 172.21.15.167:0/877533918 >> v1:172.21.15.190:6789/0 conn(0x7f9f340996b0 legacy=0x7f9f34142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:22.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f33fff640 1 -- 172.21.15.167:0/877533918 >> v1:172.21.15.167:6789/0 conn(0x7f9f34142d70 legacy=0x7f9f3414c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f32ffd640 1 -- 172.21.15.167:0/877533918 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458941048 0 0) 0x7f9f340ae2a0 con 0x7f9f34142d70 2024-09-13T17:21:22.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.078+0000 7f9f33fff640 1 -- 172.21.15.167:0/877533918 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340ad7c0 con 0x7f9f340992d0 2024-09-13T17:21:22.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f33fff640 1 --2- 172.21.15.167:0/877533918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340992d0 0x7f9f340ac300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400a960 tx=0x7f9f2401d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0410b449b9400df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f32ffd640 1 -- 172.21.15.167:0/877533918 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a67a0 con 0x7f9f340992d0 2024-09-13T17:21:22.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f32ffd640 1 -- 172.21.15.167:0/877533918 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f240a6900 con 0x7f9f340992d0 2024-09-13T17:21:22.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f32ffd640 1 -- 172.21.15.167:0/877533918 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a6c90 con 0x7f9f340992d0 2024-09-13T17:21:22.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- 172.21.15.167:0/877533918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340992d0 msgr2=0x7f9f340ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/877533918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340992d0 0x7f9f340ac300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400a960 tx=0x7f9f2401d770 comp rx=0 tx=0).stop 2024-09-13T17:21:22.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- 172.21.15.167:0/877533918 shutdown_connections 2024-09-13T17:21:22.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/877533918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340992d0 0x7f9f340ac300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- 172.21.15.167:0/877533918 >> 172.21.15.167:0/877533918 conn(0x7f9f340b3b50 msgr2=0x7f9f340b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:22.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- 172.21.15.167:0/877533918 shutdown_connections 2024-09-13T17:21:22.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- 172.21.15.167:0/877533918 wait complete. 2024-09-13T17:21:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 Processor -- start 2024-09-13T17:21:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- start start 2024-09-13T17:21:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f340992d0 0x7f9f341e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340996b0 0x7f9f3409a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f34142d70 0x7f9f3409ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3413bfb0 con 0x7f9f340996b0 2024-09-13T17:21:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340ae980 con 0x7f9f340992d0 2024-09-13T17:21:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340ae6a0 con 0x7f9f34142d70 2024-09-13T17:21:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340996b0 0x7f9f3409a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340996b0 0x7f9f3409a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46356/0 (socket says 172.21.15.167:46356) 2024-09-13T17:21:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 -- 172.21.15.167:0/722089711 learned_addr learned my addr 172.21.15.167:0/722089711 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f33fff640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f340992d0 0x7f9f341e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f38eec640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f34142d70 0x7f9f3409ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 -- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f34142d70 msgr2=0x7f9f3409ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f34142d70 0x7f9f3409ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 -- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f340992d0 msgr2=0x7f9f341e17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f340992d0 0x7f9f341e17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 -- 172.21.15.167:0/722089711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2400a5c0 con 0x7f9f340996b0 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f38eec640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f34142d70 0x7f9f3409ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f337fe640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340996b0 0x7f9f3409a8a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800b410 tx=0x7f9f2800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f30ff9640 1 -- 172.21.15.167:0/722089711 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28004020 con 0x7f9f340996b0 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f30ff9640 1 -- 172.21.15.167:0/722089711 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f28004180 con 0x7f9f340996b0 2024-09-13T17:21:22.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f341e20b0 con 0x7f9f340996b0 2024-09-13T17:21:22.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f30ff9640 1 -- 172.21.15.167:0/722089711 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28011630 con 0x7f9f340996b0 2024-09-13T17:21:22.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.082+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3409bc20 con 0x7f9f340996b0 2024-09-13T17:21:22.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.086+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3409a5c0 con 0x7f9f340996b0 2024-09-13T17:21:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.086+0000 7f9f30ff9640 1 -- 172.21.15.167:0/722089711 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f28011790 con 0x7f9f340996b0 2024-09-13T17:21:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.086+0000 7f9f30ff9640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f20066690 0x7f9f20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.086+0000 7f9f30ff9640 1 -- 172.21.15.167:0/722089711 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f28084180 con 0x7f9f340996b0 2024-09-13T17:21:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.086+0000 7f9f33fff640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f20066690 0x7f9f20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.086+0000 7f9f33fff640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f20066690 0x7f9f20068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f240b0000 tx=0x7f9f240a8070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.090+0000 7f9f30ff9640 1 -- 172.21.15.167:0/722089711 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f3409a5c0 con 0x7f9f340996b0 2024-09-13T17:21:22.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.246+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f3409a5c0 con 0x7f9f340996b0 2024-09-13T17:21:22.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.246+0000 7f9f30ff9640 1 -- 172.21.15.167:0/722089711 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f3409a5c0 con 0x7f9f340996b0 2024-09-13T17:21:22.250 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:22.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f20066690 msgr2=0x7f9f20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f20066690 0x7f9f20068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f240b0000 tx=0x7f9f240a8070 comp rx=0 tx=0).stop 2024-09-13T17:21:22.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340996b0 msgr2=0x7f9f3409a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340996b0 0x7f9f3409a8a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800b410 tx=0x7f9f2800b8d0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 shutdown_connections 2024-09-13T17:21:22.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9f20066690 0x7f9f20068b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f34142d70 0x7f9f3409ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f340996b0 0x7f9f3409a8a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 --2- 172.21.15.167:0/722089711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f340992d0 0x7f9f341e17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 >> 172.21.15.167:0/722089711 conn(0x7f9f340b3b50 msgr2=0x7f9f340b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:22.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 shutdown_connections 2024-09-13T17:21:22.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.250+0000 7f9f3a94f640 1 -- 172.21.15.167:0/722089711 wait complete. 2024-09-13T17:21:22.268 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:21:22.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.390+0000 7feaf2740640 1 Processor -- start 2024-09-13T17:21:22.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf2740640 1 -- start start 2024-09-13T17:21:22.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf2740640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feaec09a650 0x7feaec145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf2740640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feaec06a830 0x7feaec150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf2740640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec06a3a0 con 0x7feaec0bada0 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf2740640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaec0b6c40 con 0x7feaec06a830 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf2740640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaec145fd0 con 0x7feaec09a650 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf0cdd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feaec06a830 0x7feaec150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaebfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feaec0bada0 0x7feaec099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35342/0 (socket says 172.21.15.167:35342) 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaebfff640 1 -- 172.21.15.167:0/3893002153 learned_addr learned my addr 172.21.15.167:0/3893002153 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feae3fff640 1 --2- 172.21.15.167:0/3893002153 >> v2:172.21.15.190:3300/0 conn(0x7feaec09a650 0x7feaec145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf0cdd640 1 -- 172.21.15.167:0/3893002153 >> v2:172.21.15.190:3300/0 conn(0x7feaec09a650 msgr2=0x7feaec145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf0cdd640 1 --2- 172.21.15.167:0/3893002153 >> v2:172.21.15.190:3300/0 conn(0x7feaec09a650 0x7feaec145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf0cdd640 1 -- 172.21.15.167:0/3893002153 >> v1:172.21.15.167:6789/0 conn(0x7feaec0bada0 legacy=0x7feaec099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf0cdd640 1 -- 172.21.15.167:0/3893002153 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0bb180 con 0x7feaec06a830 2024-09-13T17:21:22.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaf0cdd640 1 --2- 172.21.15.167:0/3893002153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a830 0x7feaec150380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feaec0b7470 tx=0x7feae401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b75ff4e71c1a812 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaeb7fe640 1 -- 172.21.15.167:0/3893002153 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40a5980 con 0x7feaec06a830 2024-09-13T17:21:22.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaeb7fe640 1 -- 172.21.15.167:0/3893002153 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae40a5ae0 con 0x7feaec06a830 2024-09-13T17:21:22.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.394+0000 7feaeb7fe640 1 -- 172.21.15.167:0/3893002153 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40a5e70 con 0x7feaec06a830 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- 172.21.15.167:0/3893002153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a830 msgr2=0x7feaec150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 --2- 172.21.15.167:0/3893002153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a830 0x7feaec150380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feaec0b7470 tx=0x7feae401c8a0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- 172.21.15.167:0/3893002153 shutdown_connections 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 --2- 172.21.15.167:0/3893002153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a830 0x7feaec150380 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 --2- 172.21.15.167:0/3893002153 >> v2:172.21.15.190:3300/0 conn(0x7feaec09a650 0x7feaec145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- 172.21.15.167:0/3893002153 >> 172.21.15.167:0/3893002153 conn(0x7feaec0b7e40 msgr2=0x7feaec0b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- 172.21.15.167:0/3893002153 shutdown_connections 2024-09-13T17:21:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- 172.21.15.167:0/3893002153 wait complete. 2024-09-13T17:21:22.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 Processor -- start 2024-09-13T17:21:22.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- start start 2024-09-13T17:21:22.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaec06a830 0x7feaec1423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec0bada0 0x7feaec1e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaec0b50d0 0x7feaec0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0b2ee0 con 0x7feaec0bada0 2024-09-13T17:21:22.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0b5550 con 0x7feaec0b50d0 2024-09-13T17:21:22.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec1e1c10 con 0x7feaec06a830 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec0bada0 0x7feaec1e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec0bada0 0x7feaec1e16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46368/0 (socket says 172.21.15.167:46368) 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 -- 172.21.15.167:0/1314930869 learned_addr learned my addr 172.21.15.167:0/1314930869 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf0cdd640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaec0b50d0 0x7feaec0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaebfff640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaec06a830 0x7feaec1423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 -- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaec06a830 msgr2=0x7feaec1423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaec06a830 0x7feaec1423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 -- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaec0b50d0 msgr2=0x7feaec0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaec0b50d0 0x7feaec0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 -- 172.21.15.167:0/1314930869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae4009a70 con 0x7feaec0bada0 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaebfff640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaec06a830 0x7feaec1423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae3fff640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec0bada0 0x7feaec1e16d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fead400d800 tx=0x7fead400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae97fa640 1 -- 172.21.15.167:0/1314930869 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400b6c0 con 0x7feaec0bada0 2024-09-13T17:21:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae97fa640 1 -- 172.21.15.167:0/1314930869 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead400b820 con 0x7feaec0bada0 2024-09-13T17:21:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feae97fa640 1 -- 172.21.15.167:0/1314930869 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400bb90 con 0x7feaec0bada0 2024-09-13T17:21:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec0b43f0 con 0x7feaec0bada0 2024-09-13T17:21:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.398+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec142f70 con 0x7feaec0bada0 2024-09-13T17:21:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.402+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaec0b3090 con 0x7feaec0bada0 2024-09-13T17:21:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.402+0000 7feae97fa640 1 -- 172.21.15.167:0/1314930869 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fead400bcf0 con 0x7feaec0bada0 2024-09-13T17:21:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.402+0000 7feae97fa640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feacc066690 0x7feacc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.402+0000 7feae97fa640 1 -- 172.21.15.167:0/1314930869 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fead4084990 con 0x7feaec0bada0 2024-09-13T17:21:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.402+0000 7feaebfff640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feacc066690 0x7feacc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.402+0000 7feaebfff640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feacc066690 0x7feacc068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feadc005890 tx=0x7feadc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.406+0000 7feae97fa640 1 -- 172.21.15.167:0/1314930869 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feaec0b3090 con 0x7feaec0bada0 2024-09-13T17:21:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.562+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feaec145a90 con 0x7feaec0bada0 2024-09-13T17:21:22.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.562+0000 7feae97fa640 1 -- 172.21.15.167:0/1314930869 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fead4055530 con 0x7feaec0bada0 2024-09-13T17:21:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2024-09-13T17:21:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feacc066690 msgr2=0x7feacc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feacc066690 0x7feacc068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feadc005890 tx=0x7feadc009040 comp rx=0 tx=0).stop 2024-09-13T17:21:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec0bada0 msgr2=0x7feaec1e16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec0bada0 0x7feaec1e16d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fead400d800 tx=0x7fead400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 shutdown_connections 2024-09-13T17:21:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feacc066690 0x7feacc068b50 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feadc005890 tx=0x7feadc009040 comp rx=0 tx=0).stop 2024-09-13T17:21:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaec0b50d0 0x7feaec0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec0bada0 0x7feaec1e16d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 --2- 172.21.15.167:0/1314930869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaec06a830 0x7feaec1423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 >> 172.21.15.167:0/1314930869 conn(0x7feaec0b7e40 msgr2=0x7feaec099f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 shutdown_connections 2024-09-13T17:21:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.566+0000 7feaf2740640 1 -- 172.21.15.167:0/1314930869 wait complete. 2024-09-13T17:21:22.584 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:21:22.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.694+0000 7fb726c76640 1 Processor -- start 2024-09-13T17:21:22.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.694+0000 7fb726c76640 1 -- start start 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7200bada0 0x7fb720145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb72009a650 0x7fb720150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72006a3a0 con 0x7fb72006a830 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200b6c40 con 0x7fb72009a650 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb720145fd0 con 0x7fb7200bada0 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb72009a650 0x7fb720150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb72009a650 0x7fb720150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46376/0 (socket says 172.21.15.167:46376) 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb717fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb72006a830 0x7fb720099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35350/0 (socket says 172.21.15.167:35350) 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 -- 172.21.15.167:0/1604325699 learned_addr learned my addr 172.21.15.167:0/1604325699 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb724a12640 1 --2- 172.21.15.167:0/1604325699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7200bada0 0x7fb720145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 -- 172.21.15.167:0/1604325699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7200bada0 msgr2=0x7fb720145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:22.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 --2- 172.21.15.167:0/1604325699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7200bada0 0x7fb720145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 -- 172.21.15.167:0/1604325699 >> v1:172.21.15.167:6789/0 conn(0x7fb72006a830 legacy=0x7fb720099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 -- 172.21.15.167:0/1604325699 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200bb180 con 0x7fb72009a650 2024-09-13T17:21:22.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb7177fe640 1 -- 172.21.15.167:0/1604325699 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38566834 0 0) 0x7fb72006a3a0 con 0x7fb72006a830 2024-09-13T17:21:22.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb725213640 1 --2- 172.21.15.167:0/1604325699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72009a650 0x7fb720150380 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb718009e50 tx=0x7fb71801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a90e78f3467d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb7177fe640 1 -- 172.21.15.167:0/1604325699 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180a5880 con 0x7fb72009a650 2024-09-13T17:21:22.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb7177fe640 1 -- 172.21.15.167:0/1604325699 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7180a59e0 con 0x7fb72009a650 2024-09-13T17:21:22.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb7177fe640 1 -- 172.21.15.167:0/1604325699 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180a5d70 con 0x7fb72009a650 2024-09-13T17:21:22.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 -- 172.21.15.167:0/1604325699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72009a650 msgr2=0x7fb720150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 --2- 172.21.15.167:0/1604325699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72009a650 0x7fb720150380 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb718009e50 tx=0x7fb71801c9a0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 -- 172.21.15.167:0/1604325699 shutdown_connections 2024-09-13T17:21:22.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 --2- 172.21.15.167:0/1604325699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72009a650 0x7fb720150380 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 --2- 172.21.15.167:0/1604325699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7200bada0 0x7fb720145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.698+0000 7fb726c76640 1 -- 172.21.15.167:0/1604325699 >> 172.21.15.167:0/1604325699 conn(0x7fb7200b7e40 msgr2=0x7fb7200b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- 172.21.15.167:0/1604325699 shutdown_connections 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- 172.21.15.167:0/1604325699 wait complete. 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 Processor -- start 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- start start 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb72006a830 0x7fb72009fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7200bada0 0x7fb72013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72013e6f0 0x7fb7201dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201432e0 con 0x7fb72013e6f0 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200b0fb0 con 0x7fb7200bada0 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201df520 con 0x7fb72006a830 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72013e6f0 0x7fb7201dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72013e6f0 0x7fb7201dfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46384/0 (socket says 172.21.15.167:46384) 2024-09-13T17:21:22.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 -- 172.21.15.167:0/2077208599 learned_addr learned my addr 172.21.15.167:0/2077208599 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:22.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb724a12640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb72006a830 0x7fb72009fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 -- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb72006a830 msgr2=0x7fb72009fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb72006a830 0x7fb72009fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb717fff640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7200bada0 0x7fb72013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 -- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7200bada0 msgr2=0x7fb72013e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7200bada0 0x7fb72013e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 -- 172.21.15.167:0/2077208599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009b30 con 0x7fb72013e6f0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb724a12640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb72006a830 0x7fb72009fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb725213640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72013e6f0 0x7fb7201dfd20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb7180af040 tx=0x7fb718019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb7157fa640 1 -- 172.21.15.167:0/2077208599 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180b8470 con 0x7fb72013e6f0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb7157fa640 1 -- 172.21.15.167:0/2077208599 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7180b85d0 con 0x7fb72013e6f0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7201df800 con 0x7fb72013e6f0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb7157fa640 1 -- 172.21.15.167:0/2077208599 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180b8960 con 0x7fb72013e6f0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7200b0bf0 con 0x7fb72013e6f0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720145a90 con 0x7fb72013e6f0 2024-09-13T17:21:22.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.702+0000 7fb7157fa640 1 -- 172.21.15.167:0/2077208599 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7180b8ac0 con 0x7fb72013e6f0 2024-09-13T17:21:22.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.706+0000 7fb7157fa640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb70c0666c0 0x7fb70c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.706+0000 7fb7157fa640 1 -- 172.21.15.167:0/2077208599 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb71811f760 con 0x7fb72013e6f0 2024-09-13T17:21:22.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.706+0000 7fb724a12640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb70c0666c0 0x7fb70c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.706+0000 7fb724a12640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb70c0666c0 0x7fb70c068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0097a0 tx=0x7fb71c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.710+0000 7fb7157fa640 1 -- 172.21.15.167:0/2077208599 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7180ec870 con 0x7fb72013e6f0 2024-09-13T17:21:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb7201df660 con 0x7fb72013e6f0 2024-09-13T17:21:22.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb7157fa640 1 -- 172.21.15.167:0/2077208599 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb7201df660 con 0x7fb72013e6f0 2024-09-13T17:21:22.857 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:21:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb70c0666c0 msgr2=0x7fb70c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb70c0666c0 0x7fb70c068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0097a0 tx=0x7fb71c008040 comp rx=0 tx=0).stop 2024-09-13T17:21:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72013e6f0 msgr2=0x7fb7201dfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72013e6f0 0x7fb7201dfd20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb7180af040 tx=0x7fb718019740 comp rx=0 tx=0).stop 2024-09-13T17:21:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 shutdown_connections 2024-09-13T17:21:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb70c0666c0 0x7fb70c068b80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb72013e6f0 0x7fb7201dfd20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7200bada0 0x7fb72013e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 --2- 172.21.15.167:0/2077208599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb72006a830 0x7fb72009fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 >> 172.21.15.167:0/2077208599 conn(0x7fb7200b7e40 msgr2=0x7fb7200b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:22.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 shutdown_connections 2024-09-13T17:21:22.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.854+0000 7fb726c76640 1 -- 172.21.15.167:0/2077208599 wait complete. 2024-09-13T17:21:22.875 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:21:22.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.990+0000 7f133e588640 1 Processor -- start 2024-09-13T17:21:22.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.990+0000 7f133e588640 1 -- start start 2024-09-13T17:21:22.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133e588640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f133806bde0 0x7f13380b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133e588640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133806c1c0 con 0x7f13380a0b60 2024-09-13T17:21:22.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133e588640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1338146950 con 0x7f13380b6690 2024-09-13T17:21:22.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133e588640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133806b380 con 0x7f133806bde0 2024-09-13T17:21:22.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f13380a0b60 0x7f13381502c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35354/0 (socket says 172.21.15.167:35354) 2024-09-13T17:21:22.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 -- 172.21.15.167:0/2358440654 learned_addr learned my addr 172.21.15.167:0/2358440654 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1337fff640 1 --2- 172.21.15.167:0/2358440654 >> v2:172.21.15.190:3300/0 conn(0x7f133806bde0 0x7f13380b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733220543 0 0) 0x7f133806c1c0 con 0x7f13380a0b60 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1324003530 con 0x7f13380a0b60 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3980030649 0 0) 0x7f1324003530 con 0x7f13380a0b60 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 >> v2:172.21.15.190:3300/0 conn(0x7f133806bde0 msgr2=0x7f13380b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 --2- 172.21.15.167:0/2358440654 >> v2:172.21.15.190:3300/0 conn(0x7f133806bde0 0x7f13380b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 >> v1:172.21.15.190:6789/0 conn(0x7f13380b6690 legacy=0x7f13380a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338145e70 con 0x7f13380a0b60 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f1330001a00 con 0x7f13380a0b60 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 >> v1:172.21.15.167:6789/0 conn(0x7f13380a0b60 legacy=0x7f13381502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1324003980 0x7f1324003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1324004380 0x7f1324004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13240050f0 0x7f132400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133806b380 con 0x7f13240050f0 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132400c030 con 0x7f1324004380 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132400c1f0 con 0x7f1324003980 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13240050f0 0x7f132400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1337fff640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1324003980 0x7f1324003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f13377fe640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1324004380 0x7f1324004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 -- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1324003980 msgr2=0x7f1324003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1324003980 0x7f1324003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 -- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1324004380 msgr2=0x7f1324004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1324004380 0x7f1324004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 -- 172.21.15.167:0/2358440654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324003530 con 0x7f13240050f0 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 -- 172.21.15.167:0/2358440654 reap_dead start 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f133cb25640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13240050f0 0x7f132400b990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1330005af0 tx=0x7f13300200f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f683ffdc4e199a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300ad070 con 0x7f13240050f0 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13300a9d50 con 0x7f13240050f0 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.994+0000 7f1336ffd640 1 -- 172.21.15.167:0/2358440654 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330008360 con 0x7f13240050f0 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/2358440654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13240050f0 msgr2=0x7f132400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13240050f0 0x7f132400b990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1330005af0 tx=0x7f13300200f0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/2358440654 shutdown_connections 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 --2- 172.21.15.167:0/2358440654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13240050f0 0x7f132400b990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/2358440654 >> 172.21.15.167:0/2358440654 conn(0x7f13380b7e80 msgr2=0x7f13380b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/2358440654 shutdown_connections 2024-09-13T17:21:23.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/2358440654 wait complete. 2024-09-13T17:21:23.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 Processor -- start 2024-09-13T17:21:23.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- start start 2024-09-13T17:21:23.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13240050f0 0x7f13381404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1338143130 0x7f13381cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13381cd720 0x7f13381de880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13381cc0d0 con 0x7f1338143130 2024-09-13T17:21:23.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13381cc990 con 0x7f13381cd720 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13381cbaa0 con 0x7f13240050f0 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1338143130 0x7f13381cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1338143130 0x7f13381cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46398/0 (socket says 172.21.15.167:46398) 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 -- 172.21.15.167:0/1953039850 learned_addr learned my addr 172.21.15.167:0/1953039850 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f1337fff640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13240050f0 0x7f13381404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133cb25640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13381cd720 0x7f13381de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 -- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13240050f0 msgr2=0x7f13381404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13240050f0 0x7f13381404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 -- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13381cd720 msgr2=0x7f13381de880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13381cd720 0x7f13381de880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 -- 172.21.15.167:0/1953039850 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338142220 con 0x7f1338143130 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133cb25640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13381cd720 0x7f13381de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:23.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f13377fe640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1338143130 0x7f13381cc450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f132000e4e0 tx=0x7f132000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f1334ff9640 1 -- 172.21.15.167:0/1953039850 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200052e0 con 0x7f1338143130 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f1334ff9640 1 -- 172.21.15.167:0/1953039850 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1320005440 con 0x7f1338143130 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13381cdee0 con 0x7f1338143130 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f1334ff9640 1 -- 172.21.15.167:0/1953039850 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320003820 con 0x7f1338143130 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13381cbcf0 con 0x7f1338143130 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:22.998+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1338145a20 con 0x7f1338143130 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.002+0000 7f1334ff9640 1 -- 172.21.15.167:0/1953039850 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1320003980 con 0x7f1338143130 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.002+0000 7f1334ff9640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f13180666c0 0x7f1318068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.002+0000 7f1337fff640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f13180666c0 0x7f1318068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.002+0000 7f1334ff9640 1 -- 172.21.15.167:0/1953039850 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1320084100 con 0x7f1338143130 2024-09-13T17:21:23.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.002+0000 7f1337fff640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f13180666c0 0x7f1318068b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1328009910 tx=0x7f1328008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.006+0000 7f1334ff9640 1 -- 172.21.15.167:0/1953039850 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1320051210 con 0x7f1338143130 2024-09-13T17:21:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.198+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13380b74b0 con 0x7f1338143130 2024-09-13T17:21:23.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.198+0000 7f1334ff9640 1 -- 172.21.15.167:0/1953039850 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3221 (secure 0 0 0) 0x7f1320054830 con 0x7f1338143130 2024-09-13T17:21:23.202 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:23.202 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:21:13.609389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:21:23.202 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 8 2024-09-13T17:21:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f13180666c0 msgr2=0x7f1318068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f13180666c0 0x7f1318068b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1328009910 tx=0x7f1328008040 comp rx=0 tx=0).stop 2024-09-13T17:21:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1338143130 msgr2=0x7f13381cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1338143130 0x7f13381cc450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f132000e4e0 tx=0x7f132000e9a0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 shutdown_connections 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f13180666c0 0x7f1318068b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13381cd720 0x7f13381de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1338143130 0x7f13381cc450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 --2- 172.21.15.167:0/1953039850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13240050f0 0x7f13381404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 >> 172.21.15.167:0/1953039850 conn(0x7f13380b7e80 msgr2=0x7f1338073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 shutdown_connections 2024-09-13T17:21:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.202+0000 7f133e588640 1 -- 172.21.15.167:0/1953039850 wait complete. 2024-09-13T17:21:23.221 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:21:23.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.338+0000 7fc4439db640 1 Processor -- start 2024-09-13T17:21:23.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.338+0000 7fc4439db640 1 -- start start 2024-09-13T17:21:23.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc4439db640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c06f0f0 0x7fc43c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc4439db640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc43c070bb0 0x7fc43c13d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc4439db640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c071b10 con 0x7fc43c13ddf0 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc4439db640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c06f7f0 con 0x7fc43c070bb0 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc4439db640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0b0ea0 con 0x7fc43c06f0f0 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc43c070bb0 0x7fc43c13d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc43c070bb0 0x7fc43c13d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46404/0 (socket says 172.21.15.167:46404) 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 -- 172.21.15.167:0/287429179 learned_addr learned my addr 172.21.15.167:0/287429179 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc441777640 1 --2- 172.21.15.167:0/287429179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c06f0f0 0x7fc43c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 -- 172.21.15.167:0/287429179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c06f0f0 msgr2=0x7fc43c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 --2- 172.21.15.167:0/287429179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c06f0f0 0x7fc43c0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 -- 172.21.15.167:0/287429179 >> v1:172.21.15.190:6789/0 conn(0x7fc43c13ddf0 legacy=0x7fc43c146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 -- 172.21.15.167:0/287429179 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c071df0 con 0x7fc43c070bb0 2024-09-13T17:21:23.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc440f76640 1 --2- 172.21.15.167:0/287429179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c070bb0 0x7fc43c13d8b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098a0 tx=0x7fc42c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801d505f089c276b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc433fff640 1 -- 172.21.15.167:0/287429179 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0ac600 con 0x7fc43c070bb0 2024-09-13T17:21:23.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc433fff640 1 -- 172.21.15.167:0/287429179 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c0a8050 con 0x7fc43c070bb0 2024-09-13T17:21:23.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.342+0000 7fc433fff640 1 -- 172.21.15.167:0/287429179 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0ac980 con 0x7fc43c070bb0 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- 172.21.15.167:0/287429179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c070bb0 msgr2=0x7fc43c13d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 --2- 172.21.15.167:0/287429179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c070bb0 0x7fc43c13d8b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098a0 tx=0x7fc42c01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- 172.21.15.167:0/287429179 shutdown_connections 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 --2- 172.21.15.167:0/287429179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c070bb0 0x7fc43c13d8b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 --2- 172.21.15.167:0/287429179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c06f0f0 0x7fc43c0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- 172.21.15.167:0/287429179 >> 172.21.15.167:0/287429179 conn(0x7fc43c0b7250 msgr2=0x7fc43c0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- 172.21.15.167:0/287429179 shutdown_connections 2024-09-13T17:21:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- 172.21.15.167:0/287429179 wait complete. 2024-09-13T17:21:23.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 Processor -- start 2024-09-13T17:21:23.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- start start 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c06f0f0 0x7fc43c140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc43c070bb0 0x7fc43c1dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c13ddf0 0x7fc43c1dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c138240 con 0x7fc43c06f0f0 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c138770 con 0x7fc43c070bb0 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c139050 con 0x7fc43c13ddf0 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c06f0f0 0x7fc43c140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c06f0f0 0x7fc43c140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46416/0 (socket says 172.21.15.167:46416) 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 -- 172.21.15.167:0/1397890644 learned_addr learned my addr 172.21.15.167:0/1397890644 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441f78640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c13ddf0 0x7fc43c1dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 -- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c13ddf0 msgr2=0x7fc43c1dcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c13ddf0 0x7fc43c1dcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc440f76640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc43c070bb0 0x7fc43c1dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 -- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc43c070bb0 msgr2=0x7fc43c1dc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc43c070bb0 0x7fc43c1dc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 -- 172.21.15.167:0/1397890644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0094d0 con 0x7fc43c06f0f0 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc441777640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c06f0f0 0x7fc43c140dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc43800d800 tx=0x7fc43800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc431ffb640 1 -- 172.21.15.167:0/1397890644 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800b6c0 con 0x7fc43c06f0f0 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc431ffb640 1 -- 172.21.15.167:0/1397890644 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43800b820 con 0x7fc43c06f0f0 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c139330 con 0x7fc43c06f0f0 2024-09-13T17:21:23.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc431ffb640 1 -- 172.21.15.167:0/1397890644 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800bb90 con 0x7fc43c06f0f0 2024-09-13T17:21:23.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.346+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c138490 con 0x7fc43c06f0f0 2024-09-13T17:21:23.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.350+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c0b0960 con 0x7fc43c06f0f0 2024-09-13T17:21:23.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.350+0000 7fc431ffb640 1 -- 172.21.15.167:0/1397890644 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc43800bcf0 con 0x7fc43c06f0f0 2024-09-13T17:21:23.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.350+0000 7fc431ffb640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc420066690 0x7fc420068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.350+0000 7fc431ffb640 1 -- 172.21.15.167:0/1397890644 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc438084980 con 0x7fc43c06f0f0 2024-09-13T17:21:23.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.350+0000 7fc440f76640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc420066690 0x7fc420068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.350+0000 7fc440f76640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc420066690 0x7fc420068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0ae000 tx=0x7fc42c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.354+0000 7fc431ffb640 1 -- 172.21.15.167:0/1397890644 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc438051a90 con 0x7fc43c06f0f0 2024-09-13T17:21:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.514+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc43c13baa0 con 0x7fc43c06f0f0 2024-09-13T17:21:23.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.514+0000 7fc431ffb640 1 -- 172.21.15.167:0/1397890644 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fc438011340 con 0x7fc43c06f0f0 2024-09-13T17:21:23.519 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:23.519 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:20:55.351608+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc420066690 msgr2=0x7fc420068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc420066690 0x7fc420068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0ae000 tx=0x7fc42c008040 comp rx=0 tx=0).stop 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c06f0f0 msgr2=0x7fc43c140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c06f0f0 0x7fc43c140dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc43800d800 tx=0x7fc43800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 shutdown_connections 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc420066690 0x7fc420068b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc43c13ddf0 0x7fc43c1dcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc43c070bb0 0x7fc43c1dc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 --2- 172.21.15.167:0/1397890644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c06f0f0 0x7fc43c140dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 >> 172.21.15.167:0/1397890644 conn(0x7fc43c0b7250 msgr2=0x7fc43c0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:23.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 shutdown_connections 2024-09-13T17:21:23.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.518+0000 7fc4439db640 1 -- 172.21.15.167:0/1397890644 wait complete. 2024-09-13T17:21:23.539 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:21:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.650+0000 7f4f0d101640 1 Processor -- start 2024-09-13T17:21:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.650+0000 7f4f0d101640 1 -- start start 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0d101640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4f080bbdc0 0x7f4f080b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0d101640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f080b6450 0x7f4f0813f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0d101640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f080ba8f0 con 0x7f4f0813fd80 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0d101640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f080bc1a0 con 0x7f4f080b6450 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0d101640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f080ba2a0 con 0x7f4f080bbdc0 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f080b6450 0x7f4f0813f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f080b6450 0x7f4f0813f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46420/0 (socket says 172.21.15.167:46420) 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 -- 172.21.15.167:0/2669781399 learned_addr learned my addr 172.21.15.167:0/2669781399 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f06d9d640 1 --2- 172.21.15.167:0/2669781399 >> v2:172.21.15.190:3300/0 conn(0x7f4f080bbdc0 0x7f4f080b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 -- 172.21.15.167:0/2669781399 >> v2:172.21.15.190:3300/0 conn(0x7f4f080bbdc0 msgr2=0x7f4f080b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 --2- 172.21.15.167:0/2669781399 >> v2:172.21.15.190:3300/0 conn(0x7f4f080bbdc0 0x7f4f080b9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 -- 172.21.15.167:0/2669781399 >> v1:172.21.15.167:6789/0 conn(0x7f4f0813fd80 legacy=0x7f4f08148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0659c640 1 -- 172.21.15.167:0/2669781399 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819768960 0 0) 0x7f4f080ba8f0 con 0x7f4f0813fd80 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 -- 172.21.15.167:0/2669781399 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080ba580 con 0x7f4f080b6450 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f06d9d640 1 --2- 172.21.15.167:0/2669781399 >> v2:172.21.15.190:3300/0 conn(0x7f4f080bbdc0 0x7f4f080b9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4efffff640 1 --2- 172.21.15.167:0/2669781399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080b6450 0x7f4f0813f840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4f0809e190 tx=0x7f4ef001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cca62efe321c88f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0659c640 1 -- 172.21.15.167:0/2669781399 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00aa610 con 0x7f4f080b6450 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0659c640 1 -- 172.21.15.167:0/2669781399 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef00a6040 con 0x7f4f080b6450 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.654+0000 7f4f0659c640 1 -- 172.21.15.167:0/2669781399 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00aa990 con 0x7f4f080b6450 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/2669781399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080b6450 msgr2=0x7f4f0813f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 --2- 172.21.15.167:0/2669781399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080b6450 0x7f4f0813f840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4f0809e190 tx=0x7f4ef001c490 comp rx=0 tx=0).stop 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/2669781399 shutdown_connections 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 --2- 172.21.15.167:0/2669781399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080b6450 0x7f4f0813f840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 --2- 172.21.15.167:0/2669781399 >> v2:172.21.15.190:3300/0 conn(0x7f4f080bbdc0 0x7f4f080b9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/2669781399 >> 172.21.15.167:0/2669781399 conn(0x7f4f0809d700 msgr2=0x7f4f080bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/2669781399 shutdown_connections 2024-09-13T17:21:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/2669781399 wait complete. 2024-09-13T17:21:23.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 Processor -- start 2024-09-13T17:21:23.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- start start 2024-09-13T17:21:23.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f080b6450 0x7f4f081406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f080bbdc0 0x7f4f0809ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f0813fd80 0x7f4f08147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0813a5c0 con 0x7f4f0813fd80 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08141790 con 0x7f4f080bbdc0 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08141a70 con 0x7f4f080b6450 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f0813fd80 0x7f4f08147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f0813fd80 0x7f4f08147f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46428/0 (socket says 172.21.15.167:46428) 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 -- 172.21.15.167:0/4112185510 learned_addr learned my addr 172.21.15.167:0/4112185510 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f06d9d640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f080b6450 0x7f4f081406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4efffff640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f080bbdc0 0x7f4f0809ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 -- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f080b6450 msgr2=0x7f4f081406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f080b6450 0x7f4f081406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 -- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f080bbdc0 msgr2=0x7f4f0809ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f080bbdc0 0x7f4f0809ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 -- 172.21.15.167:0/4112185510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00094d0 con 0x7f4f0813fd80 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f06d9d640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f080b6450 0x7f4f081406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0759e640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f0813fd80 0x7f4f08147f30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000c6d0 tx=0x7f4f0000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4eff7fe640 1 -- 172.21.15.167:0/4112185510 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00003b80 con 0x7f4f0813fd80 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0809e4a0 con 0x7f4f0813fd80 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0809ea60 con 0x7f4f0813fd80 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.658+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0809eca0 con 0x7f4f0813fd80 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.662+0000 7f4eff7fe640 1 -- 172.21.15.167:0/4112185510 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00001750 con 0x7f4f0813fd80 2024-09-13T17:21:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.662+0000 7f4eff7fe640 1 -- 172.21.15.167:0/4112185510 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00005290 con 0x7f4f0813fd80 2024-09-13T17:21:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.662+0000 7f4eff7fe640 1 -- 172.21.15.167:0/4112185510 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f000053f0 con 0x7f4f0813fd80 2024-09-13T17:21:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.662+0000 7f4eff7fe640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4ee80666c0 0x7f4ee8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.662+0000 7f4eff7fe640 1 -- 172.21.15.167:0/4112185510 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f000843e0 con 0x7f4f0813fd80 2024-09-13T17:21:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.662+0000 7f4f06d9d640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4ee80666c0 0x7f4ee8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.662+0000 7f4f06d9d640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4ee80666c0 0x7f4ee8068b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4f0809f960 tx=0x7f4ef8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:23.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.666+0000 7f4eff7fe640 1 -- 172.21.15.167:0/4112185510 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f00055030 con 0x7f4f0813fd80 2024-09-13T17:21:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.842+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f0809eca0 con 0x7f4f0813fd80 2024-09-13T17:21:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.842+0000 7f4eff7fe640 1 -- 172.21.15.167:0/4112185510 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3221 (secure 0 0 0) 0x7f4f00017cb0 con 0x7f4f0813fd80 2024-09-13T17:21:23.848 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:21:23.848 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:21:13.609389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:21:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 8 2024-09-13T17:21:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4ee80666c0 msgr2=0x7f4ee8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4ee80666c0 0x7f4ee8068b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4f0809f960 tx=0x7f4ef8008040 comp rx=0 tx=0).stop 2024-09-13T17:21:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f0813fd80 msgr2=0x7f4f08147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f0813fd80 0x7f4f08147f30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000c6d0 tx=0x7f4f0000cb90 comp rx=0 tx=0).stop 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 shutdown_connections 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4ee80666c0 0x7f4ee8068b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f0813fd80 0x7f4f08147f30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f080bbdc0 0x7f4f0809ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 --2- 172.21.15.167:0/4112185510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f080b6450 0x7f4f081406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 >> 172.21.15.167:0/4112185510 conn(0x7f4f0809d700 msgr2=0x7f4f080b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 shutdown_connections 2024-09-13T17:21:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:23.846+0000 7f4f0d101640 1 -- 172.21.15.167:0/4112185510 wait complete. 2024-09-13T17:21:24.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:20:50.924847+0000', 'modified': '2024-09-13T17:21:13.609389+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6835/583998386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 583998386}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 583998386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:21:24.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:21:24.069 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:21:24.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb895e0b640 1 Processor -- start 2024-09-13T17:21:24.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb895e0b640 1 -- start start 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb895e0b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8900aca80 0x7fb8900ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb895e0b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb89009cb40 0x7fb89009cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb895e0b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900ae000 con 0x7fb890071d00 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb895e0b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89009d4b0 con 0x7fb8900aca80 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb895e0b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900b2c00 con 0x7fb89009cb40 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88f7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8900aca80 0x7fb8900ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88effd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb890071d00 0x7fb8900b30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35372/0 (socket says 172.21.15.167:35372) 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88effd640 1 -- 172.21.15.167:0/1014898666 learned_addr learned my addr 172.21.15.167:0/1014898666 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88e7fc640 1 -- 172.21.15.167:0/1014898666 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624608158 0 0) 0x7fb8900ae000 con 0x7fb890071d00 2024-09-13T17:21:24.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1014898666 >> v2:172.21.15.190:3300/0 conn(0x7fb89009cb40 msgr2=0x7fb89009cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88ffff640 1 --2- 172.21.15.167:0/1014898666 >> v2:172.21.15.190:3300/0 conn(0x7fb89009cb40 0x7fb89009cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1014898666 >> v2:172.21.15.190:3300/0 conn(0x7fb89009cb40 0x7fb89009cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1014898666 >> v1:172.21.15.167:6789/0 conn(0x7fb890071d00 legacy=0x7fb8900b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1014898666 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb890145cb0 con 0x7fb8900aca80 2024-09-13T17:21:24.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.194+0000 7fb88ffff640 1 --2- 172.21.15.167:0/1014898666 >> v2:172.21.15.190:3300/0 conn(0x7fb89009cb40 0x7fb89009cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:24.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1014898666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8900aca80 0x7fb8900ace60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb890071740 tx=0x7fb88001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2770e8d22dfb3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88e7fc640 1 -- 172.21.15.167:0/1014898666 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800ac620 con 0x7fb8900aca80 2024-09-13T17:21:24.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88e7fc640 1 -- 172.21.15.167:0/1014898666 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8800ac780 con 0x7fb8900aca80 2024-09-13T17:21:24.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88e7fc640 1 -- 172.21.15.167:0/1014898666 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800acb10 con 0x7fb8900aca80 2024-09-13T17:21:24.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- 172.21.15.167:0/1014898666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8900aca80 msgr2=0x7fb8900ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 --2- 172.21.15.167:0/1014898666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8900aca80 0x7fb8900ace60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb890071740 tx=0x7fb88001c3c0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- 172.21.15.167:0/1014898666 shutdown_connections 2024-09-13T17:21:24.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 --2- 172.21.15.167:0/1014898666 >> v2:172.21.15.190:3300/0 conn(0x7fb89009cb40 0x7fb89009cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 --2- 172.21.15.167:0/1014898666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8900aca80 0x7fb8900ace60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- 172.21.15.167:0/1014898666 >> 172.21.15.167:0/1014898666 conn(0x7fb8900b3b50 msgr2=0x7fb8900b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- 172.21.15.167:0/1014898666 shutdown_connections 2024-09-13T17:21:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- 172.21.15.167:0/1014898666 wait complete. 2024-09-13T17:21:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 Processor -- start 2024-09-13T17:21:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- start start 2024-09-13T17:21:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb89009cb40 0x7fb8901dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8900aca80 0x7fb8900ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89013e1c0 0x7fb89013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900b0e80 con 0x7fb89009cb40 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900b0270 con 0x7fb89013e1c0 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900b0830 con 0x7fb8900aca80 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb89009cb40 0x7fb8901dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb89009cb40 0x7fb8901dcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46456/0 (socket says 172.21.15.167:46456) 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 -- 172.21.15.167:0/2591112697 learned_addr learned my addr 172.21.15.167:0/2591112697 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88effd640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8900aca80 0x7fb8900ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 -- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8900aca80 msgr2=0x7fb8900ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88ffff640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89013e1c0 0x7fb89013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8900aca80 0x7fb8900ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 -- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89013e1c0 msgr2=0x7fb89013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89013e1c0 0x7fb89013e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 -- 172.21.15.167:0/2591112697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880009420 con 0x7fb89009cb40 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb89009cb40 0x7fb8901dcde0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb880018fd0 tx=0x7fb880019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb877fff640 1 -- 172.21.15.167:0/2591112697 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880004030 con 0x7fb89009cb40 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb877fff640 1 -- 172.21.15.167:0/2591112697 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb880004190 con 0x7fb89009cb40 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.198+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8900b0b10 con 0x7fb89009cb40 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb877fff640 1 -- 172.21.15.167:0/2591112697 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880003620 con 0x7fb89009cb40 2024-09-13T17:21:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89013c120 con 0x7fb89009cb40 2024-09-13T17:21:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb877fff640 1 -- 172.21.15.167:0/2591112697 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8800b3040 con 0x7fb89009cb40 2024-09-13T17:21:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb877fff640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb87c066690 0x7fb87c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb877fff640 1 -- 172.21.15.167:0/2591112697 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb88011e460 con 0x7fb89009cb40 2024-09-13T17:21:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb88effd640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb87c066690 0x7fb87c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb88effd640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb87c066690 0x7fb87c068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8900716d0 tx=0x7fb884009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 Processor -- start 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 -- start start 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2772660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c27a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c27a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c2633e80 con 0x5593c27a1ca0 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c25c1af0 con 0x5593c27a45d0 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593c25bf0c0 con 0x5593c2772280 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb88effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c27a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb88effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c27a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46464/0 (socket says 172.21.15.167:46464) 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb88effd640 1 -- 172.21.15.167:0/120782297 learned_addr learned my addr 172.21.15.167:0/120782297 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb88effd640 1 -- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 msgr2=0x5593c2772660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.202+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2772660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2772660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88ffff640 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c27a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 -- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 msgr2=0x5593c27a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c27a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 -- 172.21.15.167:0/120782297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c22b6890 con 0x5593c27a1ca0 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88ffff640 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c27a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c27a4090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb884005ba0 tx=0x7fb884010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c37778b8a63fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb8757fa640 1 -- 172.21.15.167:0/120782297 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88400dbb0 con 0x5593c27a1ca0 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb8757fa640 1 -- 172.21.15.167:0/120782297 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88400dd10 con 0x5593c27a1ca0 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb8757fa640 1 -- 172.21.15.167:0/120782297 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884020650 con 0x5593c27a1ca0 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/120782297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 msgr2=0x5593c27a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c27a4090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb884005ba0 tx=0x7fb884010000 comp rx=0 tx=0).stop 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/120782297 shutdown_connections 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c27a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c27a4090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- 172.21.15.167:0/120782297 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2772660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/120782297 >> 172.21.15.167:0/120782297 conn(0x5593c27977e0 msgr2=0x5593c2799bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/120782297 shutdown_connections 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/120782297 wait complete. 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- start start 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 Processor -- start 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c2772280 0x5593c27971b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c279b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c25ba9b0 con 0x5593c2772280 2024-09-13T17:21:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c2559c00 con 0x5593c27a45d0 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593c2578070 con 0x5593c27a1ca0 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 10 client.0 _ll_register_callbacks cb 0x5593c2757ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c2772280 0x5593c27971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c2772280 0x5593c27971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46478/0 (socket says 172.21.15.167:46478) 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1373730902 learned_addr learned my addr 172.21.15.167:0/1373730902 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88ffff640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c279b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 msgr2=0x5593c279b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 msgr2=0x5593c279b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c279b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1373730902 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8840058e0 con 0x5593c2772280 2024-09-13T17:21:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88ffff640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c279b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c2772280 0x5593c27971b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8800eb730 tx=0x7fb8800eee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24773e8e0f7b67c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb86e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb86e7fc640 1 -- 172.21.15.167:0/1373730902 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88011e2b0 con 0x5593c2772280 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593c25775f0 con 0x5593c2772280 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb86e7fc640 1 -- 172.21.15.167:0/1373730902 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8800f3060 con 0x5593c2772280 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb86e7fc640 1 -- 172.21.15.167:0/1373730902 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8800f7620 con 0x5593c2772280 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 10 client.4866 fetch_fsmap learned FSMap version 8 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5593c257fab0 con 0x5593c2772280 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb86e7fc640 1 -- 172.21.15.167:0/1373730902 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593c25775f0 con 0x5593c2772280 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb86e7fc640 1 -- 172.21.15.167:0/1373730902 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 8) v1 ==== 2032+0+0 (secure 0 0 0) 0x7fb88011c2a0 con 0x5593c2772280 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 10 client.4866 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 10 client.4866 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:21:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 20 client.4866 populate_metadata read hostname 'smithi167' 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c279c380 0x5593c27b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 4 client.4866 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 --> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593c25b7790 con 0x5593c279c380 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.206+0000 7fb88effd640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c279c380 0x5593c27b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb88effd640 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c279c380 0x5593c27b1d20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=592071ad5d8e486 server_cookie=1dc49835b4b801cc in_seq=0 out_seq=0 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb86e7fc640 10 client.4866 ms_handle_connect on v2:172.21.15.167:6834/583998386 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb86e7fc640 1 -- 172.21.15.167:0/1373730902 <== mds.0 v2:172.21.15.167:6834/583998386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5593c25b7790 con 0x5593c279c380 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb86e7fc640 10 client.4866 handle_command_reply: tid=0 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 client.4866 shutdown 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c2772280 msgr2=0x5593c27971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c2772280 0x5593c27971b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8800eb730 tx=0x7fb8800eee30 comp rx=0 tx=0).stop 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 shutdown_connections 2024-09-13T17:21:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c279c380 0x5593c27b1d20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27a45d0 0x5593c279b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb86e7fc640 0 client.4866 ms_handle_reset on v2:172.21.15.167:6834/583998386 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 --2- 172.21.15.167:0/1373730902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c2772280 0x5593c27971b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 >> 172.21.15.167:0/1373730902 conn(0x5593c27977e0 msgr2=0x5593c27a2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 shutdown_connections 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 1 -- 172.21.15.167:0/1373730902 wait complete. 2024-09-13T17:21:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.210+0000 7fb898f54000 20 client.4866 trim_cache size 0 max 16384 2024-09-13T17:21:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 Processor -- start 2024-09-13T17:21:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- start start 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27977e0 0x5593c2799c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c2772280 0x5593c279a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c2277940 con 0x5593c27977e0 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c25b61a0 con 0x5593c2772280 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593c25fd5f0 con 0x5593c27a1ca0 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27977e0 0x5593c2799c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27977e0 0x5593c2799c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46482/0 (socket says 172.21.15.167:46482) 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1080882365 learned_addr learned my addr 172.21.15.167:0/1080882365 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1080882365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 msgr2=0x5593c279a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1080882365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1080882365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c2772280 msgr2=0x5593c279a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1080882365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c2772280 0x5593c279a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 -- 172.21.15.167:0/1080882365 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c2565c00 con 0x5593c27977e0 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/1080882365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27977e0 0x5593c2799c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb8800f70f0 tx=0x7fb8800c0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc4af514c91d09b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb875ffb640 1 -- 172.21.15.167:0/1080882365 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800f7620 con 0x5593c27977e0 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb875ffb640 1 -- 172.21.15.167:0/1080882365 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8800f7190 con 0x5593c27977e0 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb875ffb640 1 -- 172.21.15.167:0/1080882365 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800f3060 con 0x5593c27977e0 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- 172.21.15.167:0/1080882365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27977e0 msgr2=0x5593c2799c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- 172.21.15.167:0/1080882365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27977e0 0x5593c2799c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb8800f70f0 tx=0x7fb8800c0000 comp rx=0 tx=0).stop 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- 172.21.15.167:0/1080882365 shutdown_connections 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- 172.21.15.167:0/1080882365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c27a1ca0 0x5593c279a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- 172.21.15.167:0/1080882365 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c2772280 0x5593c279a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- 172.21.15.167:0/1080882365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27977e0 0x5593c2799c60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- 172.21.15.167:0/1080882365 >> 172.21.15.167:0/1080882365 conn(0x5593c27a0230 msgr2=0x5593c2797bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- 172.21.15.167:0/1080882365 shutdown_connections 2024-09-13T17:21:24.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- 172.21.15.167:0/1080882365 wait complete. 2024-09-13T17:21:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- start start 2024-09-13T17:21:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 Processor -- start 2024-09-13T17:21:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2805060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27977e0 0x5593c28055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c2805ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c25b7db0 con 0x5593c27a1ca0 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c2578250 con 0x5593c27977e0 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593c257c4c0 con 0x5593c2772280 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb898f54000 10 client.0 _ll_register_callbacks cb 0x5593c2737e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c2805ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c2805ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46490/0 (socket says 172.21.15.167:46490) 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88ffff640 1 -- 172.21.15.167:0/272993659 learned_addr learned my addr 172.21.15.167:0/272993659 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88effd640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27977e0 0x5593c28055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.226+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2805060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88ffff640 1 -- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 msgr2=0x5593c2805060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88ffff640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2805060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88ffff640 1 -- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27977e0 msgr2=0x5593c28055a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88ffff640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27977e0 0x5593c28055a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88ffff640 1 -- 172.21.15.167:0/272993659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593c257fab0 con 0x5593c27a1ca0 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88effd640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27977e0 0x5593c28055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88ffff640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c2805ae0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb88800ab00 tx=0x7fb888008f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f2b6d0d9b680ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 1 -- 172.21.15.167:0/272993659 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888009ea0 con 0x5593c27a1ca0 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 1 -- 172.21.15.167:0/272993659 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8880088b0 con 0x5593c27a1ca0 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593c258a460 con 0x5593c27a1ca0 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 1 -- 172.21.15.167:0/272993659 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb88801bbe0 con 0x5593c27a1ca0 2024-09-13T17:21:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 10 client.4872 fetch_fsmap learned FSMap version 8 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5593c22b6cc0 con 0x5593c27a1ca0 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 1 -- 172.21.15.167:0/272993659 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593c258a460 con 0x5593c27a1ca0 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 1 -- 172.21.15.167:0/272993659 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 8) v1 ==== 2032+0+0 (secure 0 0 0) 0x7fb888008040 con 0x5593c27a1ca0 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 10 client.4872 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 10 client.4872 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 20 client.4872 populate_metadata read hostname 'smithi167' 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c27a45d0 0x5593c27d6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 4 client.4872 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 --> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5593c25839c0 con 0x5593c27a45d0 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c27a45d0 0x5593c27d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 10 client.4872 ms_handle_connect on v2:172.21.15.167:6834/583998386 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb88f7fe640 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c27a45d0 0x5593c27d6230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13822d2140bc99b server_cookie=92eec1f52646d214 in_seq=0 out_seq=0 2024-09-13T17:21:24.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 1 -- 172.21.15.167:0/272993659 <== mds.0 v2:172.21.15.167:6834/583998386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5593c25839c0 con 0x5593c27a45d0 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 10 client.4872 handle_command_reply: tid=0 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 client.4872 shutdown 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 msgr2=0x5593c2805ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c2805ae0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb88800ab00 tx=0x7fb888008f30 comp rx=0 tx=0).stop 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 shutdown_connections 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:6834/583998386,v1:172.21.15.167:6835/583998386] conn(0x5593c27a45d0 0x5593c27d6230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593c27a1ca0 0x5593c2805ae0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb86e7fc640 0 client.4872 ms_handle_reset on v2:172.21.15.167:6834/583998386 2024-09-13T17:21:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593c27977e0 0x5593c28055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 --2- 172.21.15.167:0/272993659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5593c2772280 0x5593c2805060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 >> 172.21.15.167:0/272993659 conn(0x5593c27a0230 msgr2=0x5593c27983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 shutdown_connections 2024-09-13T17:21:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 1 -- 172.21.15.167:0/272993659 wait complete. 2024-09-13T17:21:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb898f54000 20 client.4872 trim_cache size 0 max 16384 2024-09-13T17:21:24.241 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:21:24.241 INFO:teuthology.orchestra.run.smithi167.stdout: "cluster_fsid": "77832f00-b4f4-4330-b095-2fc2c7bace94", 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "whoami": 0, 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4272, 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "want_state": "up:active", 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "up:active", 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs", 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "rank_uptime": 33.305546671000002, 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsmap_epoch": 8, 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch": 27, 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch_barrier": 27, 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout: "uptime": 39.360301403999998 2024-09-13T17:21:24.242 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:21:24.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb87c066690 msgr2=0x7fb87c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb87c066690 0x7fb87c068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8900716d0 tx=0x7fb884009040 comp rx=0 tx=0).stop 2024-09-13T17:21:24.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb89009cb40 msgr2=0x7fb8901dcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb89009cb40 0x7fb8901dcde0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb880018fd0 tx=0x7fb880019160 comp rx=0 tx=0).stop 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 shutdown_connections 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb87c066690 0x7fb87c068b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb89013e1c0 0x7fb89013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8900aca80 0x7fb8900ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 --2- 172.21.15.167:0/2591112697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb89009cb40 0x7fb8901dcde0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 >> 172.21.15.167:0/2591112697 conn(0x7fb8900b3b50 msgr2=0x7fb89009bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 shutdown_connections 2024-09-13T17:21:24.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.230+0000 7fb895e0b640 1 -- 172.21.15.167:0/2591112697 wait complete. 2024-09-13T17:21:24.250 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T17:21:24.259 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T17:21:24.259 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T17:21:24.259 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T17:21:24.260 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T17:21:24.389 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T17:21:24.389 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-13T17:21:24.389 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T17:21:24.390 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:21:24.390 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:24.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:24.390 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-13T17:21:24.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T17:21:24.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:24.398 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:21:24.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:24.453 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-09-13T17:21:24.633 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T17:21:24.633 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:21:24.633 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:21:24.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.758+0000 7f5cf6b38640 1 Processor -- start 2024-09-13T17:21:24.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.758+0000 7f5cf6b38640 1 -- start start 2024-09-13T17:21:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.758+0000 7f5cf6b38640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5cf00b2bf0 0x7f5cf0141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.758+0000 7f5cf6b38640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf01454d0 con 0x7f5cf013c260 2024-09-13T17:21:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cf6b38640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf01457b0 con 0x7f5cf0072180 2024-09-13T17:21:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cf6b38640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf006ee70 con 0x7f5cf00b2bf0 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cf48d4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5cf013c260 0x7f5cf00b24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35380/0 (socket says 172.21.15.167:35380) 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cf48d4640 1 -- 172.21.15.167:0/724182909 learned_addr learned my addr 172.21.15.167:0/724182909 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 --2- 172.21.15.167:0/724182909 >> v2:172.21.15.190:3300/0 conn(0x7f5cf00b2bf0 0x7f5cf0141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865032286 0 0) 0x7f5cf01454d0 con 0x7f5cf013c260 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cdc003530 con 0x7f5cf013c260 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3141094500 0 0) 0x7f5cdc003530 con 0x7f5cf013c260 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 >> v2:172.21.15.190:3300/0 conn(0x7f5cf00b2bf0 msgr2=0x7f5cf0141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 --2- 172.21.15.167:0/724182909 >> v2:172.21.15.190:3300/0 conn(0x7f5cf00b2bf0 0x7f5cf0141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 >> v1:172.21.15.190:6789/0 conn(0x7f5cf0072180 legacy=0x7f5cf014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0145a90 con 0x7f5cf013c260 2024-09-13T17:21:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f5ce8001a00 con 0x7f5cf013c260 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 >> v1:172.21.15.167:6789/0 conn(0x7f5cf013c260 legacy=0x7f5cf00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cdc003980 0x7f5cdc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cdc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cdc005190 0x7f5cdc00caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc00d1c0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc005960 con 0x7f5cdc005190 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc005b20 con 0x7f5cdc003980 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cdc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cf50d5640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cdc005190 0x7f5cdc00caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cf48d4640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cdc003980 0x7f5cdc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 -- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cdc003980 msgr2=0x7f5cdc003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cdc003980 0x7f5cdc003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 -- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cdc005190 msgr2=0x7f5cdc00caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cdc005190 0x7f5cdc00caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cf50d5640 1 -- 172.21.15.167:0/724182909 reap_dead start 2024-09-13T17:21:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 -- 172.21.15.167:0/724182909 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc003530 con 0x7f5cdc0047d0 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5ceffff640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cdc004c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009ae0 tx=0x7f5cd801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34d9faf8d2ac2ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80a6450 con 0x7f5cdc0047d0 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd80a65b0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.762+0000 7f5cef7fe640 1 -- 172.21.15.167:0/724182909 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80a6960 con 0x7f5cdc0047d0 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- 172.21.15.167:0/724182909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 msgr2=0x7f5cdc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cdc004c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009ae0 tx=0x7f5cd801ca70 comp rx=0 tx=0).stop 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- 172.21.15.167:0/724182909 shutdown_connections 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/724182909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cdc004c50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- 172.21.15.167:0/724182909 >> 172.21.15.167:0/724182909 conn(0x7f5cf00b7250 msgr2=0x7f5cf00b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- 172.21.15.167:0/724182909 shutdown_connections 2024-09-13T17:21:24.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- 172.21.15.167:0/724182909 wait complete. 2024-09-13T17:21:24.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 Processor -- start 2024-09-13T17:21:24.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- start start 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cf00adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cf0144220 0x7f5cf00704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf0070a00 0x7f5cf0136380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01446a0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00ad5b0 con 0x7f5cf0070a00 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00aba60 con 0x7f5cf0144220 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cf00adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cf00adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46498/0 (socket says 172.21.15.167:46498) 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 -- 172.21.15.167:0/752257112 learned_addr learned my addr 172.21.15.167:0/752257112 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5ceffff640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cf0144220 0x7f5cf00704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf50d5640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf0070a00 0x7f5cf0136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 -- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cf0144220 msgr2=0x7f5cf00704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cf0144220 0x7f5cf00704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 -- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf0070a00 msgr2=0x7f5cf0136380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf0070a00 0x7f5cf0136380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 -- 172.21.15.167:0/752257112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00abd40 con 0x7f5cdc0047d0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5ceffff640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cf0144220 0x7f5cf00704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf48d4640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cf00adfe0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007a10 tx=0x7f5ce800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5ced7fa640 1 -- 172.21.15.167:0/752257112 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8007b00 con 0x7f5cdc0047d0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5ced7fa640 1 -- 172.21.15.167:0/752257112 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800ee50 con 0x7f5cdc0047d0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf00ac020 con 0x7f5cdc0047d0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5ced7fa640 1 -- 172.21.15.167:0/752257112 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8013660 con 0x7f5cdc0047d0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.766+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01368c0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.770+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf00ab8c0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.770+0000 7f5ced7fa640 1 -- 172.21.15.167:0/752257112 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ce80137c0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.770+0000 7f5ced7fa640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5cd00666c0 0x7f5cd0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:24.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.770+0000 7f5ceffff640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5cd00666c0 0x7f5cd0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:24.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.770+0000 7f5ced7fa640 1 -- 172.21.15.167:0/752257112 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ce80849b0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.770+0000 7f5ceffff640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5cd00666c0 0x7f5cd0068b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ad000 tx=0x7f5cd80046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.774+0000 7f5ced7fa640 1 -- 172.21.15.167:0/752257112 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5cf00ab8c0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5cf00ab8c0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5ced7fa640 1 -- 172.21.15.167:0/752257112 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5cf00ab8c0 con 0x7f5cdc0047d0 2024-09-13T17:21:24.977 INFO:teuthology.orchestra.run.smithi167.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:21:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5cd00666c0 msgr2=0x7f5cd0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5cd00666c0 0x7f5cd0068b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ad000 tx=0x7f5cd80046d0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 msgr2=0x7f5cf00adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cf00adfe0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007a10 tx=0x7f5ce800e530 comp rx=0 tx=0).stop 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 shutdown_connections 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5cd00666c0 0x7f5cd0068b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf0070a00 0x7f5cf0136380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cf0144220 0x7f5cf00704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 --2- 172.21.15.167:0/752257112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cdc0047d0 0x7f5cf00adfe0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 >> 172.21.15.167:0/752257112 conn(0x7f5cf00b7250 msgr2=0x7f5cf00af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 shutdown_connections 2024-09-13T17:21:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:21:24.974+0000 7f5cf6b38640 1 -- 172.21.15.167:0/752257112 wait complete. 2024-09-13T17:21:24.995 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:21:24.995 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:21:24.996 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-09-13T17:21:24.996 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:21:24.996 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:24.996 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:21:24.996 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:21:24.996 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:21:24.996 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:21:24.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:24.996 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-09-13T17:21:25.002 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:21:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:21:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:21:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42458sec preferred_lft 42458sec 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 02:42:7c:99:bf:e5 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:21:25.004 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:21:25.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.004 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:21:25.005 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:21:25.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:21:25.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2024-09-13T17:21:25.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2024-09-13T17:21:25.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:21:25.005 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:21:25.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.082 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:21:25.133 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-13T17:21:25.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.135 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-09-13T17:21:25.184 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-09-13T17:21:25.184 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:21:25.184 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:21:25.184 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:21:25.184 INFO:teuthology.orchestra.run.smithi167.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:21:25.185 INFO:teuthology.orchestra.run.smithi167.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:21:25.185 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:21:25.185 INFO:teuthology.orchestra.run.smithi167.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:21:25.185 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:21:25.185 INFO:teuthology.orchestra.run.smithi167.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:21:25.185 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:21:25.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.185 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:21:25.185 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:21:25.185 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:21:25.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:21:25.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:21:25.186 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:21:25.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.259 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-13T17:21:25.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.309 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-09-13T17:21:25.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.357 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:21:25.357 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:21:25.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:21:25.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T17:21:25.357 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:21:25.426 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T17:21:25.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T17:21:25.426 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:21:25.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.520 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-09-13T17:21:25.520 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-13T17:21:25.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2024-09-13T17:21:25.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:21:25.520 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-13T17:21:25.539 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:21:25.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:21:25.539 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:25.587 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:21:25.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:21:25.588 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:25.635 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-13T17:21:25.700 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:21:25.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:21:25.750 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:21:25.751 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:21:25.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.752 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-13T17:21:25.800 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:21:25.800 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:21:25.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-13T17:21:25.861 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:21:25.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:21:25.917 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:21:25.918 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:21:25.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:25.918 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-13T17:21:25.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:2024-09-13T17:21:25.922+0000 7fa34912f580 -1 init, newargv = 0x56148aa1c0d0 newargc=15 2024-09-13T17:21:25.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:ceph-fuse[36768]: starting ceph client 2024-09-13T17:21:25.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:ceph-fuse[36768]: starting fuse 2024-09-13T17:21:27.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-13T17:21:27.045 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:21:27.045 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:21:27.100 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:21:27.101 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:21:27.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:27.102 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-13T17:21:27.148 INFO:teuthology.orchestra.run.smithi167.stdout:45 2024-09-13T17:21:27.149 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> import re 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> import os 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:27.150 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> return f 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.0")) 2024-09-13T17:21:27.151 DEBUG:teuthology.orchestra.run.smithi167:> ' 2024-09-13T17:21:27.270 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.0.36768.asok 2024-09-13T17:21:27.452 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36768.asok 2024-09-13T17:21:27.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:27.453 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36768.asok status 2024-09-13T17:21:27.608 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:21:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "0", 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "36768", 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4884, 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2024-09-13T17:21:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4884 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 1879601376 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 1879601376 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-13T17:21:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4884 192.168.0.1:0/1879601376", 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.1:0/1879601376", 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 8, 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 27, 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2024-09-13T17:21:27.611 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:21:27.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:27.622 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2024-09-13T17:21:27.623 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:27.629 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2024-09-13T17:21:27.629 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:27.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:21:27.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:27.684 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T17:21:27.698 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:21:27.699 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T17:21:27.699 INFO:tasks.workunit:timeout=3h 2024-09-13T17:21:27.699 INFO:tasks.workunit:cleanup=True 2024-09-13T17:21:27.699 DEBUG:teuthology.orchestra.run.smithi167:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:27.733 INFO:teuthology.orchestra.run.smithi167.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:27.733 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T17:21:27.733 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-09-13T17:21:27.733 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:21:27.734 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T17:21:27.734 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-13 17:20:50.929229875 +0000 2024-09-13T17:21:27.734 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-13 17:21:00.901597682 +0000 2024-09-13T17:21:27.734 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-13T17:21:27.734 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T17:21:27.735 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T17:21:27.797 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:21:27.850 INFO:tasks.workunit.client.0.smithi167.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T17:21:51.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:21:51.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:22:21.733 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:22:21.736 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:22:26.043 INFO:tasks.workunit.client.0.smithi167.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T17:22:26.043 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr: git switch -c 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr:Or undo this operation with: 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr: git switch - 2024-09-13T17:22:26.044 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:26.045 INFO:tasks.workunit.client.0.smithi167.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T17:22:26.045 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:26.045 INFO:tasks.workunit.client.0.smithi167.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:22:26.051 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T17:22:26.057 INFO:tasks.workunit.client.0.smithi167.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T17:22:26.060 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:22:26.061 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T17:22:26.878 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T17:22:26.989 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T17:22:27.049 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:22:27.050 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:22:27.050 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T17:22:27.098 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:22:27.102 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:22:27.102 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T17:22:27.149 INFO:tasks.workunit:Running workunits matching fs/misc/acl.sh on client.0... 2024-09-13T17:22:27.150 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2024-09-13T17:22:27.151 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-09-13T17:22:27.211 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2024-09-13T17:22:27.211 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir -p testdir 2024-09-13T17:22:27.213 INFO:tasks.workunit.client.0.smithi167.stderr:+ cd testdir 2024-09-13T17:22:27.214 INFO:tasks.workunit.client.0.smithi167.stderr:+ set +e 2024-09-13T17:22:27.214 INFO:tasks.workunit.client.0.smithi167.stderr:+ setfacl -d -m u:nobody:rw . 2024-09-13T17:22:27.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 0 != 0 2024-09-13T17:22:27.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2024-09-13T17:22:27.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=0 2024-09-13T17:22:27.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 0 -lt 100 ] 2024-09-13T17:22:27.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 0 + 1 2024-09-13T17:22:27.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=1 2024-09-13T17:22:27.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:27.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:27.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:27.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:27.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:27.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:27.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:27.831 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:28.039 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:28.039 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:28.064 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.064 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.064 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 1 -lt 100 ] 2024-09-13T17:22:28.064 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 1 + 1 2024-09-13T17:22:28.094 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=2 2024-09-13T17:22:28.094 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:28.117 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:28.117 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:28.120 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:28.120 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:28.120 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:28.515 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:28.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:28.550 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:28.550 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:28.555 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.555 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.555 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -lt 100 ] 2024-09-13T17:22:28.555 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 2 + 1 2024-09-13T17:22:28.561 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=3 2024-09-13T17:22:28.561 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:28.566 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:28.566 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:28.568 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:28.568 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:28.568 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:28.674 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:28.674 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:28.688 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:28.689 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:28.693 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.693 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.694 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 3 -lt 100 ] 2024-09-13T17:22:28.694 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 3 + 1 2024-09-13T17:22:28.697 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=4 2024-09-13T17:22:28.697 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:28.702 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:28.702 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:28.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:28.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:28.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:28.773 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:28.774 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:28.960 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:28.960 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:28.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:28.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 4 -lt 100 ] 2024-09-13T17:22:28.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 4 + 1 2024-09-13T17:22:29.002 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=5 2024-09-13T17:22:29.002 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:29.016 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:29.017 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:29.019 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:29.019 INFO:tasks.workunit.client.0.smithi167.stderr:+ + sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:29.019 INFO:tasks.workunit.client.0.smithi167.stderr:echo 3 2024-09-13T17:22:29.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:29.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:29.501 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:29.501 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:29.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:29.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:29.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 5 -lt 100 ] 2024-09-13T17:22:29.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 5 + 1 2024-09-13T17:22:29.551 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=6 2024-09-13T17:22:29.552 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:29.564 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:29.564 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:29.566 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:29.566 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:29.566 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:29.984 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:29.985 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:30.145 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:30.145 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:30.160 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:30.160 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:30.160 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 6 -lt 100 ] 2024-09-13T17:22:30.160 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 6 + 1 2024-09-13T17:22:30.176 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=7 2024-09-13T17:22:30.176 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:30.187 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:30.187 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:30.190 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:30.190 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:30.190 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:30.601 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:30.602 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:30.728 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:30.728 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:30.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:30.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:30.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 7 -lt 100 ] 2024-09-13T17:22:30.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 7 + 1 2024-09-13T17:22:30.759 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=8 2024-09-13T17:22:30.759 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:30.772 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:30.772 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:30.774 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:30.774 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:30.775 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:31.120 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:31.120 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:31.237 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:31.237 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:31.260 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:31.260 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:31.260 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 8 -lt 100 ] 2024-09-13T17:22:31.260 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 8 + 1 2024-09-13T17:22:31.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=9 2024-09-13T17:22:31.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:31.296 INFO:tasks.workunit.client.0.smithi167.stderr:+ + getfacl d1 2024-09-13T17:22:31.296 INFO:tasks.workunit.client.0.smithi167.stderr:grep -c nobody:rw 2024-09-13T17:22:31.299 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:31.300 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:31.300 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:31.723 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:31.723 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:31.845 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:31.845 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:31.871 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:31.871 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:31.871 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 9 -lt 100 ] 2024-09-13T17:22:31.871 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 9 + 1 2024-09-13T17:22:31.909 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=10 2024-09-13T17:22:31.909 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:31.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:31.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:31.925 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:31.925 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:31.925 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:32.303 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:32.303 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:32.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:32.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:32.486 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:32.486 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:32.486 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 10 -lt 100 ] 2024-09-13T17:22:32.486 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 10 + 1 2024-09-13T17:22:32.518 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=11 2024-09-13T17:22:32.518 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:32.529 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:32.530 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:32.532 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:32.532 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:32.532 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:33.014 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.015 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.148 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:33.148 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:33.162 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.162 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.162 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 11 -lt 100 ] 2024-09-13T17:22:33.162 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 11 + 1 2024-09-13T17:22:33.176 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=12 2024-09-13T17:22:33.176 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:33.187 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.187 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.189 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:33.189 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:33.189 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:33.633 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.635 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.664 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:33.664 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:33.670 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.670 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.670 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 12 -lt 100 ] 2024-09-13T17:22:33.670 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 12 + 1 2024-09-13T17:22:33.673 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=13 2024-09-13T17:22:33.673 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:33.680 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.680 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.681 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:33.681 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:33.682 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:33.804 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.805 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.819 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:33.819 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:33.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.825 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 13 -lt 100 ] 2024-09-13T17:22:33.825 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 13 + 1 2024-09-13T17:22:33.828 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=14 2024-09-13T17:22:33.828 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:33.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.835 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:33.836 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:33.836 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:33.940 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.941 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.971 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:33.971 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:33.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:33.977 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 14 -lt 100 ] 2024-09-13T17:22:33.977 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 14 + 1 2024-09-13T17:22:33.980 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=15 2024-09-13T17:22:33.980 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:33.984 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:33.985 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:33.986 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:33.986 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:33.986 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.074 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.078 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.097 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.097 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.102 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.102 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.102 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 15 -lt 100 ] 2024-09-13T17:22:34.102 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 15 + 1 2024-09-13T17:22:34.107 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=16 2024-09-13T17:22:34.107 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:34.113 INFO:tasks.workunit.client.0.smithi167.stderr:+ + getfacl d1 2024-09-13T17:22:34.113 INFO:tasks.workunit.client.0.smithi167.stderr:grep -c nobody:rw 2024-09-13T17:22:34.116 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:34.116 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:34.116 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.201 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.201 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.222 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.222 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.227 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.227 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 16 -lt 100 ] 2024-09-13T17:22:34.227 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 16 + 1 2024-09-13T17:22:34.232 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=17 2024-09-13T17:22:34.232 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:34.237 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.239 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:34.239 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:34.239 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.332 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.333 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.350 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.351 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.355 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.355 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.355 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 17 -lt 100 ] 2024-09-13T17:22:34.355 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 17 + 1 2024-09-13T17:22:34.361 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=18 2024-09-13T17:22:34.361 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:34.367 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.367 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.369 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:34.369 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:34.369 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.457 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.474 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.475 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.479 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.479 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.480 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 18 -lt 100 ] 2024-09-13T17:22:34.480 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 18 + 1 2024-09-13T17:22:34.484 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=19 2024-09-13T17:22:34.484 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:34.490 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.490 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.492 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:34.492 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:34.492 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.583 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.585 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.609 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.609 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.614 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.615 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.615 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 19 -lt 100 ] 2024-09-13T17:22:34.615 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 19 + 1 2024-09-13T17:22:34.618 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=20 2024-09-13T17:22:34.619 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:34.625 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.625 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.627 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:34.627 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:34.627 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.713 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.714 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.738 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.738 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.742 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.742 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.742 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 20 -lt 100 ] 2024-09-13T17:22:34.742 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 20 + 1 2024-09-13T17:22:34.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=21 2024-09-13T17:22:34.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:34.752 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.752 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.753 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:34.753 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:34.753 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.842 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:34.842 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:34.867 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.867 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.874 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.874 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.875 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 21 -lt 100 ] 2024-09-13T17:22:34.875 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 21 + 1 2024-09-13T17:22:34.878 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=22 2024-09-13T17:22:34.878 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:34.884 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.884 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.886 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:34.886 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:34.886 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:34.969 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:34.970 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:34.996 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:34.996 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:34.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:34.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 22 -lt 100 ] 2024-09-13T17:22:34.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 22 + 1 2024-09-13T17:22:35.004 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=23 2024-09-13T17:22:35.004 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.010 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.010 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.011 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.012 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.012 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:35.098 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.098 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.118 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:35.118 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:35.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 23 -lt 100 ] 2024-09-13T17:22:35.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 23 + 1 2024-09-13T17:22:35.126 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=24 2024-09-13T17:22:35.126 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.132 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.132 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.134 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.134 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.134 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:35.229 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.230 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.253 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:35.253 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:35.259 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.259 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.259 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 24 -lt 100 ] 2024-09-13T17:22:35.260 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 24 + 1 2024-09-13T17:22:35.263 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=25 2024-09-13T17:22:35.263 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.268 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.268 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.269 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.269 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.269 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:35.357 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.358 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.382 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:35.383 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:35.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 25 -lt 100 ] 2024-09-13T17:22:35.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 25 + 1 2024-09-13T17:22:35.393 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=26 2024-09-13T17:22:35.393 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.399 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.399 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.401 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.401 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.401 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:35.484 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.484 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.508 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:35.508 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:35.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 26 -lt 100 ] 2024-09-13T17:22:35.523 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 26 + 1 2024-09-13T17:22:35.528 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=27 2024-09-13T17:22:35.528 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.533 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.533 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.534 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.535 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.535 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:35.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.652 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:35.652 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:35.659 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.659 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.659 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 27 -lt 100 ] 2024-09-13T17:22:35.659 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 27 + 1 2024-09-13T17:22:35.664 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=28 2024-09-13T17:22:35.665 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.671 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.671 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.673 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.673 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.673 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:35.807 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.807 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.829 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:35.829 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:35.842 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.842 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.842 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 28 -lt 100 ] 2024-09-13T17:22:35.842 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 28 + 1 2024-09-13T17:22:35.847 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=29 2024-09-13T17:22:35.847 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.854 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.854 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.856 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.856 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.856 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:35.946 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.947 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.975 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:35.975 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:35.979 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.979 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:35.979 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 29 -lt 100 ] 2024-09-13T17:22:35.979 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 29 + 1 2024-09-13T17:22:35.983 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=30 2024-09-13T17:22:35.983 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:35.989 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:35.989 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:35.991 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:35.991 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:35.991 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:36.074 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.075 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.103 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:36.103 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:36.107 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.107 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.107 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 30 -lt 100 ] 2024-09-13T17:22:36.107 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 30 + 1 2024-09-13T17:22:36.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=31 2024-09-13T17:22:36.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:36.116 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.116 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.118 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:36.118 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:36.118 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:36.197 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.198 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.211 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:36.212 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:36.216 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.216 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.216 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 31 -lt 100 ] 2024-09-13T17:22:36.216 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 31 + 1 2024-09-13T17:22:36.220 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=32 2024-09-13T17:22:36.220 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:36.225 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.225 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:36.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:36.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:36.319 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.319 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.333 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:36.333 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:36.337 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.338 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.338 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 32 -lt 100 ] 2024-09-13T17:22:36.338 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 32 + 1 2024-09-13T17:22:36.343 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=33 2024-09-13T17:22:36.343 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:36.347 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.347 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.349 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:36.349 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:36.349 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:36.434 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.435 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.450 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:36.450 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:36.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 33 -lt 100 ] 2024-09-13T17:22:36.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 33 + 1 2024-09-13T17:22:36.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=34 2024-09-13T17:22:36.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:36.463 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.463 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.464 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:36.464 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:36.465 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:36.549 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.550 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.576 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:36.577 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:36.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 34 -lt 100 ] 2024-09-13T17:22:36.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 34 + 1 2024-09-13T17:22:36.586 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=35 2024-09-13T17:22:36.586 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:36.592 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.592 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:36.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:36.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:36.700 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.701 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.754 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:36.754 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:36.761 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.761 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.761 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 35 -lt 100 ] 2024-09-13T17:22:36.761 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 35 + 1 2024-09-13T17:22:36.764 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=36 2024-09-13T17:22:36.765 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:36.770 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.770 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.772 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:36.772 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:36.772 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:36.892 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.893 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.908 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:36.908 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:36.912 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.912 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:36.912 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 36 -lt 100 ] 2024-09-13T17:22:36.913 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 36 + 1 2024-09-13T17:22:36.916 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=37 2024-09-13T17:22:36.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:36.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:36.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:36.923 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:36.924 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:36.924 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.008 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.009 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.045 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.045 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.049 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.049 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.049 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 37 -lt 100 ] 2024-09-13T17:22:37.050 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 37 + 1 2024-09-13T17:22:37.054 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=38 2024-09-13T17:22:37.054 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.060 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.060 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.062 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.062 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.062 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.146 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.147 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.175 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.176 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.181 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.181 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.181 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 38 -lt 100 ] 2024-09-13T17:22:37.181 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 38 + 1 2024-09-13T17:22:37.184 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=39 2024-09-13T17:22:37.185 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.191 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.191 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.192 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.193 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.193 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.273 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.273 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.292 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.292 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.297 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.298 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.298 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 39 -lt 100 ] 2024-09-13T17:22:37.298 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 39 + 1 2024-09-13T17:22:37.302 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=40 2024-09-13T17:22:37.302 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.308 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.309 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.311 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.311 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.311 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.400 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.400 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.424 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.424 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.427 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.428 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.428 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 40 -lt 100 ] 2024-09-13T17:22:37.428 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 40 + 1 2024-09-13T17:22:37.431 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=41 2024-09-13T17:22:37.431 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.437 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.437 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.438 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.439 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.439 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.529 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.529 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.549 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.549 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.555 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.556 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.556 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 41 -lt 100 ] 2024-09-13T17:22:37.556 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 41 + 1 2024-09-13T17:22:37.559 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=42 2024-09-13T17:22:37.559 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.566 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.566 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.567 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.567 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.568 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.650 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.650 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.674 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.675 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.679 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.679 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.679 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 42 -lt 100 ] 2024-09-13T17:22:37.679 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 42 + 1 2024-09-13T17:22:37.684 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=43 2024-09-13T17:22:37.684 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.689 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.690 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.789 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.789 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.810 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.810 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 43 -lt 100 ] 2024-09-13T17:22:37.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 43 + 1 2024-09-13T17:22:37.818 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=44 2024-09-13T17:22:37.819 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.826 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.826 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.826 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:37.913 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:37.914 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:37.934 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:37.934 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:37.939 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.939 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:37.939 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 44 -lt 100 ] 2024-09-13T17:22:37.939 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 44 + 1 2024-09-13T17:22:37.942 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=45 2024-09-13T17:22:37.943 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:37.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:37.948 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:37.950 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:37.951 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:37.951 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:38.033 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.033 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:38.057 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:38.057 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:38.061 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.061 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.061 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 45 -lt 100 ] 2024-09-13T17:22:38.061 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 45 + 1 2024-09-13T17:22:38.065 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=46 2024-09-13T17:22:38.065 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:38.070 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.070 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:38.072 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:38.072 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:38.072 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:38.154 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.155 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:38.174 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:38.174 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:38.179 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.179 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.179 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 46 -lt 100 ] 2024-09-13T17:22:38.179 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 46 + 1 2024-09-13T17:22:38.182 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=47 2024-09-13T17:22:38.182 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:38.275 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.275 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:38.337 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:38.337 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:38.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 47 -lt 100 ] 2024-09-13T17:22:38.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 47 + 1 2024-09-13T17:22:38.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=48 2024-09-13T17:22:38.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:38.351 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.352 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:38.353 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:38.353 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:38.353 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:38.429 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.430 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:38.451 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:38.452 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:38.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:38.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 48 -lt 100 ] 2024-09-13T17:22:38.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 48 + 1 2024-09-13T17:22:38.461 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=49 2024-09-13T17:22:38.461 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:38.467 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:38.467 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:38.469 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:38.469 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:38.469 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:38.625 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:38.626 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:39.210 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:39.210 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:39.230 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:39.230 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:39.230 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 49 -lt 100 ] 2024-09-13T17:22:39.231 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 49 + 1 2024-09-13T17:22:39.259 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=50 2024-09-13T17:22:39.259 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:39.276 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:39.276 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:39.278 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:39.278 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:39.278 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:39.683 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:39.684 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:39.800 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:39.800 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:39.823 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:39.823 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:39.823 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 50 -lt 100 ] 2024-09-13T17:22:39.823 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 50 + 1 2024-09-13T17:22:39.842 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=51 2024-09-13T17:22:39.842 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:39.855 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:39.855 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:39.858 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:39.858 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:39.858 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:40.216 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:40.216 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:40.335 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:40.335 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:40.351 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.351 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.351 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 51 -lt 100 ] 2024-09-13T17:22:40.351 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 51 + 1 2024-09-13T17:22:40.357 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=52 2024-09-13T17:22:40.357 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:40.362 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:40.362 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:40.364 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:40.365 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:40.365 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:40.437 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -cgetfacl nobody:rw 2024-09-13T17:22:40.437 INFO:tasks.workunit.client.0.smithi167.stderr: d1 2024-09-13T17:22:40.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:40.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:40.460 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.460 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.460 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 52 -lt 100 ] 2024-09-13T17:22:40.461 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 52 + 1 2024-09-13T17:22:40.465 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=53 2024-09-13T17:22:40.465 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:40.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:40.471 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:40.473 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:40.473 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:40.473 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:40.545 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:40.546 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:40.581 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:40.581 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:40.590 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.590 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.590 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 53 -lt 100 ] 2024-09-13T17:22:40.591 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 53 + 1 2024-09-13T17:22:40.595 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=54 2024-09-13T17:22:40.595 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:40.600 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:40.601 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:40.602 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:40.603 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:40.603 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:40.677 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:40.677 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:40.697 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:40.697 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:40.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 54 -lt 100 ] 2024-09-13T17:22:40.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 54 + 1 2024-09-13T17:22:40.706 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=55 2024-09-13T17:22:40.707 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:40.712 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:40.712 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:40.714 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:40.714 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:40.714 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:40.803 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:40.804 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:40.927 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:40.927 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:40.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:40.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 55 -lt 100 ] 2024-09-13T17:22:40.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 55 + 1 2024-09-13T17:22:40.983 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=56 2024-09-13T17:22:40.983 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:40.998 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:40.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:41.001 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:41.001 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:41.001 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:41.164 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:41.164 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:41.270 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:41.270 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:41.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:41.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:41.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 56 -lt 100 ] 2024-09-13T17:22:41.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 56 + 1 2024-09-13T17:22:41.308 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=57 2024-09-13T17:22:41.308 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:41.320 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:41.320 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:41.322 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:41.322 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:41.322 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:41.688 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:41.689 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:41.818 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:41.819 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:41.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:41.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:41.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 57 -lt 100 ] 2024-09-13T17:22:41.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 57 + 1 2024-09-13T17:22:41.858 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=58 2024-09-13T17:22:41.858 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:41.867 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:41.868 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:41.870 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:41.870 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:41.870 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:42.212 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.213 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:42.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:42.235 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.235 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.235 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 58 -lt 100 ] 2024-09-13T17:22:42.235 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 58 + 1 2024-09-13T17:22:42.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=59 2024-09-13T17:22:42.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:42.242 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.242 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.244 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:42.244 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:42.244 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:42.328 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.329 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:42.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:42.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 59 -lt 100 ] 2024-09-13T17:22:42.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 59 + 1 2024-09-13T17:22:42.350 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=60 2024-09-13T17:22:42.350 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:42.353 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.353 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.355 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:42.355 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:42.355 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:42.456 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.457 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.587 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:42.587 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:42.600 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.600 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.600 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 60 -lt 100 ] 2024-09-13T17:22:42.600 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 60 + 1 2024-09-13T17:22:42.616 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=61 2024-09-13T17:22:42.616 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:42.626 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.626 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:42.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:42.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:42.861 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.861 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.878 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:42.878 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:42.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:42.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 61 -lt 100 ] 2024-09-13T17:22:42.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 61 + 1 2024-09-13T17:22:42.906 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=62 2024-09-13T17:22:42.906 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:42.918 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:42.918 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:42.919 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:42.920 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:42.920 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:43.196 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:43.196 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:43.237 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:43.237 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:43.252 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.253 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.253 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 62 -lt 100 ] 2024-09-13T17:22:43.253 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 62 + 1 2024-09-13T17:22:43.274 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=63 2024-09-13T17:22:43.274 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:43.279 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:43.279 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:43.281 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:43.281 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:43.281 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:43.401 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:43.402 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:43.513 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:43.513 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:43.524 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.524 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.524 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 63 -lt 100 ] 2024-09-13T17:22:43.524 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 63 + 1 2024-09-13T17:22:43.541 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=64 2024-09-13T17:22:43.541 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:43.551 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:43.551 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:43.553 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:43.553 INFO:tasks.workunit.client.0.smithi167.stderr:+ + echo 3 2024-09-13T17:22:43.553 INFO:tasks.workunit.client.0.smithi167.stderr:sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:43.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:43.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:43.771 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:43.771 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:43.778 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.778 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.778 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 64 -lt 100 ] 2024-09-13T17:22:43.778 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 64 + 1 2024-09-13T17:22:43.782 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=65 2024-09-13T17:22:43.782 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:43.786 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:43.786 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:43.788 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:43.788 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:43.788 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:43.905 INFO:tasks.workunit.client.0.smithi167.stderr:+ + getfacl d1 2024-09-13T17:22:43.905 INFO:tasks.workunit.client.0.smithi167.stderr:grep -c nobody:rw 2024-09-13T17:22:43.927 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:43.927 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:43.931 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.932 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:43.932 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 65 -lt 100 ] 2024-09-13T17:22:43.932 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 65 + 1 2024-09-13T17:22:43.936 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=66 2024-09-13T17:22:43.936 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:43.940 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:43.940 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:43.942 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:43.942 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:43.942 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:44.034 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:44.035 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:44.050 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:44.050 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:44.055 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:44.055 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:44.055 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 66 -lt 100 ] 2024-09-13T17:22:44.055 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 66 + 1 2024-09-13T17:22:44.059 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=67 2024-09-13T17:22:44.059 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:44.065 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:44.065 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:44.067 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:44.067 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:44.067 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:44.535 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:44.535 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:44.618 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:44.618 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:44.636 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:44.636 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:44.636 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 67 -lt 100 ] 2024-09-13T17:22:44.636 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 67 + 1 2024-09-13T17:22:44.674 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=68 2024-09-13T17:22:44.674 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:44.685 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:44.686 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:44.688 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:44.688 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:44.688 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:44.854 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:44.855 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:44.869 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:44.869 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:44.876 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:44.876 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:44.876 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 68 -lt 100 ] 2024-09-13T17:22:44.876 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 68 + 1 2024-09-13T17:22:44.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=69 2024-09-13T17:22:44.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:44.888 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:44.888 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:44.889 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:44.889 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:44.889 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:44.954 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:44.955 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.011 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.011 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.015 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.015 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.015 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 69 -lt 100 ] 2024-09-13T17:22:45.016 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 69 + 1 2024-09-13T17:22:45.020 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=70 2024-09-13T17:22:45.020 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.025 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.025 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.027 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.027 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.027 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.123 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.124 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.138 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.138 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.142 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.142 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.142 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 70 -lt 100 ] 2024-09-13T17:22:45.142 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 70 + 1 2024-09-13T17:22:45.147 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=71 2024-09-13T17:22:45.147 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.151 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.151 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.153 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.153 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.153 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.246 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.246 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.261 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.261 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.265 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.265 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.265 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 71 -lt 100 ] 2024-09-13T17:22:45.265 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 71 + 1 2024-09-13T17:22:45.269 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=72 2024-09-13T17:22:45.269 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.274 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.274 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.275 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.275 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.275 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.358 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.359 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.381 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.381 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 72 -lt 100 ] 2024-09-13T17:22:45.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 72 + 1 2024-09-13T17:22:45.391 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=73 2024-09-13T17:22:45.391 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.396 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.396 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.397 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.479 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.480 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.519 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.519 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.525 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.525 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.525 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 73 -lt 100 ] 2024-09-13T17:22:45.525 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 73 + 1 2024-09-13T17:22:45.529 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=74 2024-09-13T17:22:45.529 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.535 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.535 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.536 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.536 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.536 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.609 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.610 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.624 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.624 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 74 -lt 100 ] 2024-09-13T17:22:45.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 74 + 1 2024-09-13T17:22:45.633 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=75 2024-09-13T17:22:45.633 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.638 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.638 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.640 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.640 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.640 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.728 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.728 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.748 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.748 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.756 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.756 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.756 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 75 -lt 100 ] 2024-09-13T17:22:45.756 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 75 + 1 2024-09-13T17:22:45.760 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=76 2024-09-13T17:22:45.760 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.767 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.767 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.769 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.769 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.769 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.837 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.837 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.857 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.857 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.864 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.865 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.865 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 76 -lt 100 ] 2024-09-13T17:22:45.865 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 76 + 1 2024-09-13T17:22:45.869 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=77 2024-09-13T17:22:45.869 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.874 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:45.874 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:45.876 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.876 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.876 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:45.954 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.954 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:45.976 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:45.981 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.982 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:45.982 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 77 -lt 100 ] 2024-09-13T17:22:45.982 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 77 + 1 2024-09-13T17:22:45.986 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=78 2024-09-13T17:22:45.986 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:45.991 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:45.991 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:45.992 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:45.993 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:45.993 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.067 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.068 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.090 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.090 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.094 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.094 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.094 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 78 -lt 100 ] 2024-09-13T17:22:46.094 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 78 + 1 2024-09-13T17:22:46.098 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=79 2024-09-13T17:22:46.099 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.104 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:46.104 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:46.106 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.106 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.106 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.188 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.189 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.215 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.215 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.219 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.219 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.219 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 79 -lt 100 ] 2024-09-13T17:22:46.219 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 79 + 1 2024-09-13T17:22:46.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=80 2024-09-13T17:22:46.224 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.229 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.229 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.230 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.231 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.231 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.311 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.312 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.331 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.331 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.335 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.335 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.335 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 80 -lt 100 ] 2024-09-13T17:22:46.335 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 80 + 1 2024-09-13T17:22:46.339 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=81 2024-09-13T17:22:46.339 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.344 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.344 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.429 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.429 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.447 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.448 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 81 -lt 100 ] 2024-09-13T17:22:46.454 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 81 + 1 2024-09-13T17:22:46.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=82 2024-09-13T17:22:46.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.464 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.464 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.466 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.466 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.466 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.544 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.544 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.574 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.574 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.579 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.579 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.579 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 82 -lt 100 ] 2024-09-13T17:22:46.580 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 82 + 1 2024-09-13T17:22:46.583 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=83 2024-09-13T17:22:46.583 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.589 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.589 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.591 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.591 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.591 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.661 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.661 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.680 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.681 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.685 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.685 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.685 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 83 -lt 100 ] 2024-09-13T17:22:46.685 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 83 + 1 2024-09-13T17:22:46.690 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=84 2024-09-13T17:22:46.690 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.695 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.695 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.696 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.696 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.696 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.763 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.763 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.781 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.781 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.785 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.785 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.786 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 84 -lt 100 ] 2024-09-13T17:22:46.786 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 84 + 1 2024-09-13T17:22:46.789 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=85 2024-09-13T17:22:46.789 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.794 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.795 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.796 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.796 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.796 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.865 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.865 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.889 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.889 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:46.894 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.894 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:46.894 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 85 -lt 100 ] 2024-09-13T17:22:46.894 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 85 + 1 2024-09-13T17:22:46.905 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=86 2024-09-13T17:22:46.906 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:46.911 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.912 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.913 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:46.913 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:46.913 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:46.983 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:46.984 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:46.997 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:46.997 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:47.000 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.001 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.001 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 86 -lt 100 ] 2024-09-13T17:22:47.001 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 86 + 1 2024-09-13T17:22:47.004 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=87 2024-09-13T17:22:47.004 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:47.009 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:47.009 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:47.011 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:47.011 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:47.011 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:47.083 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:47.083 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:47.105 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:47.105 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:47.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 87 -lt 100 ] 2024-09-13T17:22:47.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 87 + 1 2024-09-13T17:22:47.115 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=88 2024-09-13T17:22:47.115 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:47.120 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:47.120 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:47.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:47.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:47.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:47.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:47.224 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:47.286 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:47.286 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:47.298 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.298 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.298 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 88 -lt 100 ] 2024-09-13T17:22:47.298 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 88 + 1 2024-09-13T17:22:47.315 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=89 2024-09-13T17:22:47.315 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:47.326 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:47.326 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:47.328 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:47.328 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:47.328 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:47.681 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:47.681 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:47.844 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:47.844 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:47.859 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.860 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:47.860 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 89 -lt 100 ] 2024-09-13T17:22:47.860 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 89 + 1 2024-09-13T17:22:47.882 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=90 2024-09-13T17:22:47.882 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:47.893 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:47.893 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:47.895 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:47.895 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:47.896 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:48.234 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.235 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.249 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:48.249 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:48.254 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.254 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.254 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 90 -lt 100 ] 2024-09-13T17:22:48.254 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 90 + 1 2024-09-13T17:22:48.257 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=91 2024-09-13T17:22:48.257 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:48.263 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.263 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.264 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:48.265 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:48.265 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:48.356 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.357 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.381 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:48.382 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:48.386 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.386 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.386 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 91 -lt 100 ] 2024-09-13T17:22:48.387 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 91 + 1 2024-09-13T17:22:48.390 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=92 2024-09-13T17:22:48.390 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:48.396 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.396 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:48.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:48.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:48.482 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.482 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.535 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:48.536 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:48.550 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.550 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.551 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 92 -lt 100 ] 2024-09-13T17:22:48.551 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 92 + 1 2024-09-13T17:22:48.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=93 2024-09-13T17:22:48.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:48.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.596 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:48.596 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:48.596 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:48.705 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.705 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.723 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:48.723 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:48.729 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.729 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.729 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 93 -lt 100 ] 2024-09-13T17:22:48.729 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 93 + 1 2024-09-13T17:22:48.733 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=94 2024-09-13T17:22:48.734 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:48.739 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.739 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.741 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:48.741 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:48.741 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:48.836 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.836 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.885 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:48.885 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:48.891 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.892 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.892 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 94 -lt 100 ] 2024-09-13T17:22:48.892 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 94 + 1 2024-09-13T17:22:48.896 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=95 2024-09-13T17:22:48.896 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:48.901 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.902 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.903 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:48.903 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:48.903 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:48.981 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:48.981 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:48.994 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:48.994 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:48.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:48.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 95 -lt 100 ] 2024-09-13T17:22:48.999 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 95 + 1 2024-09-13T17:22:49.003 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=96 2024-09-13T17:22:49.003 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:49.008 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.008 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.010 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:49.010 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:49.010 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:49.079 INFO:tasks.workunit.client.0.smithi167.stderr:+ + grep -c nobody:rw 2024-09-13T17:22:49.079 INFO:tasks.workunit.client.0.smithi167.stderr:getfacl d1 2024-09-13T17:22:49.098 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:49.098 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:49.102 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.103 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.103 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 96 -lt 100 ] 2024-09-13T17:22:49.103 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 96 + 1 2024-09-13T17:22:49.108 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=97 2024-09-13T17:22:49.108 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:49.113 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.113 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.114 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:49.115 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:49.115 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:49.189 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.189 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.217 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:49.217 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:49.223 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.224 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.224 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 97 -lt 100 ] 2024-09-13T17:22:49.224 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 97 + 1 2024-09-13T17:22:49.230 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=98 2024-09-13T17:22:49.230 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:49.236 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.236 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:49.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:49.238 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:49.308 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.308 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.332 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:49.333 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:49.337 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.337 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.338 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 98 -lt 100 ] 2024-09-13T17:22:49.338 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 98 + 1 2024-09-13T17:22:49.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=99 2024-09-13T17:22:49.342 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:49.348 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.348 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.349 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:49.350 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:49.350 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:49.424 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.424 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.453 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:49.453 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:49.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 99 -lt 100 ] 2024-09-13T17:22:49.458 INFO:tasks.workunit.client.0.smithi167.stderr:+ expr 99 + 1 2024-09-13T17:22:49.462 INFO:tasks.workunit.client.0.smithi167.stderr:+ c=100 2024-09-13T17:22:49.462 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:49.468 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfacl d1 2024-09-13T17:22:49.468 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep -c nobody:rw 2024-09-13T17:22:49.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ c1=2 2024-09-13T17:22:49.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2024-09-13T17:22:49.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T17:22:49.558 INFO:tasks.workunit.client.0.smithi167.stderr:+ + getfaclgrep -c nobody:rw d1 2024-09-13T17:22:49.558 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:22:49.605 INFO:tasks.workunit.client.0.smithi167.stderr:+ c2=2 2024-09-13T17:22:49.605 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:49.612 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.613 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -ne 2 ] 2024-09-13T17:22:49.613 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 100 -lt 100 ] 2024-09-13T17:22:49.613 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir d1 2024-09-13T17:22:49.618 INFO:tasks.workunit.client.0.smithi167.stderr:+ setfattr -n system.posix_acl_access -v 0x02000000 d1 2024-09-13T17:22:49.627 INFO:tasks.workunit.client.0.smithi167.stderr:+ setfattr -n system.posix_acl_default -v 0x02000000 . 2024-09-13T17:22:49.630 INFO:tasks.workunit.client.0.smithi167.stderr:+ expect_failure getfattr -n system.posix_acl_access d1 2024-09-13T17:22:49.630 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfattr -n system.posix_acl_access d1 2024-09-13T17:22:49.642 INFO:tasks.workunit.client.0.smithi167.stderr:d1: system.posix_acl_access: No such attribute 2024-09-13T17:22:49.642 INFO:tasks.workunit.client.0.smithi167.stderr:+ return 0 2024-09-13T17:22:49.642 INFO:tasks.workunit.client.0.smithi167.stderr:+ expect_failure getfattr -n system.posix_acl_default . 2024-09-13T17:22:49.642 INFO:tasks.workunit.client.0.smithi167.stderr:+ getfattr -n system.posix_acl_default . 2024-09-13T17:22:49.643 INFO:tasks.workunit.client.0.smithi167.stderr:.: system.posix_acl_default: No such attribute 2024-09-13T17:22:49.643 INFO:tasks.workunit.client.0.smithi167.stderr:+ return 0 2024-09-13T17:22:49.643 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir d1 2024-09-13T17:22:49.719 INFO:tasks.workunit.client.0.smithi167.stderr:+ cd .. 2024-09-13T17:22:49.720 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir testdir 2024-09-13T17:22:49.730 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2024-09-13T17:22:49.732 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2024-09-13T17:22:49.732 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T17:22:49.732 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T17:22:49.874 INFO:tasks.workunit:Stopping ['fs/misc/acl.sh'] on client.0... 2024-09-13T17:22:49.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T17:22:50.774 DEBUG:teuthology.parallel:result is None 2024-09-13T17:22:50.774 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:22:50.846 INFO:tasks.workunit.client.0.smithi167.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T17:22:51.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:22:51.841 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:22.048 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:22.051 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:49.485 INFO:tasks.workunit.client.0.smithi167.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T17:23:49.485 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:23:49.485 INFO:tasks.workunit.client.0.smithi167.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T17:23:49.485 INFO:tasks.workunit.client.0.smithi167.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T17:23:49.485 INFO:tasks.workunit.client.0.smithi167.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T17:23:49.485 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:23:49.485 INFO:tasks.workunit.client.0.smithi167.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr: git switch -c 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr:Or undo this operation with: 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr: git switch - 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:23:49.486 INFO:tasks.workunit.client.0.smithi167.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:23:49.494 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T17:23:49.535 INFO:tasks.workunit.client.0.smithi167.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T17:23:49.551 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:23:49.551 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T17:23:50.415 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T17:23:50.504 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T17:23:50.558 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:23:50.561 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:23:50.561 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T17:23:50.607 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:23:50.621 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:23:50.621 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T17:23:50.704 INFO:tasks.workunit:Running workunits matching fs/misc/chmod.sh on client.0... 2024-09-13T17:23:50.705 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2024-09-13T17:23:50.705 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-09-13T17:23:50.801 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2024-09-13T17:23:50.801 INFO:tasks.workunit.client.0.smithi167.stderr:+ file=test_chmod.38214 2024-09-13T17:23:50.803 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo foo 2024-09-13T17:23:50.839 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 0 != 0 2024-09-13T17:23:50.839 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 400 test_chmod.38214 2024-09-13T17:23:50.851 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 0 != 0 2024-09-13T17:23:50.851 INFO:tasks.workunit.client.0.smithi167.stderr:+ check_perms test_chmod.38214 -r-------- 2024-09-13T17:23:50.851 INFO:tasks.workunit.client.0.smithi167.stderr:+ file=test_chmod.38214 2024-09-13T17:23:50.852 INFO:tasks.workunit.client.0.smithi167.stderr:+ ls -la test_chmod.38214 2024-09-13T17:23:50.863 INFO:tasks.workunit.client.0.smithi167.stderr:+ r=-r-------- 1 ubuntu ubuntu 4 Sep 13 17:23 test_chmod.38214 2024-09-13T17:23:50.863 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 0 != 0 2024-09-13T17:23:50.864 INFO:tasks.workunit.client.0.smithi167.stderr:+ perms=-r-------- 2024-09-13T17:23:50.864 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo -r-------- 1 ubuntu ubuntu 4 Sep 13 17:23 test_chmod.38214 2024-09-13T17:23:50.868 INFO:tasks.workunit.client.0.smithi167.stderr:+ awk {print $1} 2024-09-13T17:23:50.916 INFO:tasks.workunit.client.0.smithi167.stderr:+ test -r-------- != -r-------- 2024-09-13T17:23:50.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ set +e 2024-09-13T17:23:50.917 INFO:tasks.workunit.client.0.smithi167.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: 40: cannot create test_chmod.38214: Permission denied 2024-09-13T17:23:50.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 2 = 0 2024-09-13T17:23:50.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2024-09-13T17:23:50.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 600 test_chmod.38214 2024-09-13T17:23:50.919 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo bar 2024-09-13T17:23:50.919 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 0 != 0 2024-09-13T17:23:50.919 INFO:tasks.workunit.client.0.smithi167.stderr:+ check_perms test_chmod.38214 -rw------- 2024-09-13T17:23:50.920 INFO:tasks.workunit.client.0.smithi167.stderr:+ file=test_chmod.38214 2024-09-13T17:23:50.920 INFO:tasks.workunit.client.0.smithi167.stderr:+ ls -la test_chmod.38214 2024-09-13T17:23:50.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ r=-rw------- 1 ubuntu ubuntu 8 Sep 13 17:23 test_chmod.38214 2024-09-13T17:23:50.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 0 != 0 2024-09-13T17:23:50.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ perms=-rw------- 2024-09-13T17:23:50.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo -rw------- 1 ubuntu ubuntu 8 Sep 13 17:23 test_chmod.38214 2024-09-13T17:23:50.922 INFO:tasks.workunit.client.0.smithi167.stderr:+ awk {print $1} 2024-09-13T17:23:50.924 INFO:tasks.workunit.client.0.smithi167.stderr:+ test -rw------- != -rw------- 2024-09-13T17:23:50.924 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo foo 2024-09-13T17:23:50.925 INFO:tasks.workunit.client.0.smithi167.stderr:+ test 0 != 0 2024-09-13T17:23:50.926 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T17:23:50.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T17:23:50.960 INFO:tasks.workunit:Stopping ['fs/misc/chmod.sh'] on client.0... 2024-09-13T17:23:50.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T17:23:51.283 DEBUG:teuthology.parallel:result is None 2024-09-13T17:23:51.283 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:23:51.292 INFO:tasks.workunit.client.0.smithi167.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T17:23:52.177 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:52.180 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:22.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:22.316 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:48.944 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 99% (12648/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T17:24:49.992 INFO:tasks.workunit.client.0.smithi167.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T17:24:49.992 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:24:49.992 INFO:tasks.workunit.client.0.smithi167.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr: git switch -c 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr:Or undo this operation with: 2024-09-13T17:24:49.993 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:24:49.994 INFO:tasks.workunit.client.0.smithi167.stderr: git switch - 2024-09-13T17:24:49.994 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:24:49.994 INFO:tasks.workunit.client.0.smithi167.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T17:24:49.994 INFO:tasks.workunit.client.0.smithi167.stderr: 2024-09-13T17:24:49.994 INFO:tasks.workunit.client.0.smithi167.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:24:50.002 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T17:24:50.008 INFO:tasks.workunit.client.0.smithi167.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T17:24:50.012 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:24:50.012 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T17:24:50.064 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T17:24:50.118 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T17:24:50.160 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:24:50.161 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:24:50.161 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T17:24:50.201 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:24:50.204 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:24:50.204 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T17:24:50.252 INFO:tasks.workunit:Running workunits matching fs/misc/dac_override.sh on client.0... 2024-09-13T17:24:50.253 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2024-09-13T17:24:50.254 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-09-13T17:24:50.307 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2024-09-13T17:24:50.307 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir -p testdir 2024-09-13T17:24:50.309 INFO:tasks.workunit.client.0.smithi167.stderr:+ file=test_chmod.38321 2024-09-13T17:24:50.310 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo foo 2024-09-13T17:24:50.310 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo chmod 600 testdir 2024-09-13T17:24:50.322 INFO:tasks.workunit.client.0.smithi167.stderr:+ expect_failure cat testdir/test_chmod.38321 2024-09-13T17:24:50.322 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat testdir/test_chmod.38321 2024-09-13T17:24:50.346 INFO:tasks.workunit.client.0.smithi167.stderr:cat: testdir/test_chmod.38321: Permission denied 2024-09-13T17:24:50.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ return 0 2024-09-13T17:24:50.346 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo cat testdir/test_chmod.38321 2024-09-13T17:24:50.347 INFO:tasks.workunit.client.0.smithi167.stdout:foo 2024-09-13T17:24:50.348 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T17:24:50.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T17:24:50.421 INFO:tasks.workunit:Stopping ['fs/misc/dac_override.sh'] on client.0... 2024-09-13T17:24:50.422 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T17:24:50.726 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:50.727 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:24:50.753 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:24:50.753 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T17:24:50.762 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T17:24:50.762 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:24:50.762 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:50.801 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:24:50.801 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:50.853 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:51.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.874+0000 7fa9edd30640 1 Processor -- start 2024-09-13T17:24:51.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9edd30640 1 -- start start 2024-09-13T17:24:51.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9edd30640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9e809a7b0 0x7fa9e809ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9edd30640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa9e8098a40 0x7fa9e8143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9edd30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e813d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9edd30640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80b4b80 con 0x7fa9e809a7b0 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9edd30640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e8098e80 con 0x7fa9e8098a40 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9edd30640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8144590 con 0x7fa9e8144130 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9e809a7b0 0x7fa9e809ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9e809a7b0 0x7fa9e809ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43920/0 (socket says 172.21.15.167:43920) 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 -- 172.21.15.167:0/1975000428 learned_addr learned my addr 172.21.15.167:0/1975000428 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e7fff640 1 --2- 172.21.15.167:0/1975000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e813d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e6ffd640 1 --2- 172.21.15.167:0/1975000428 >> v2:172.21.15.190:3300/0 conn(0x7fa9e8098a40 0x7fa9e8143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 -- 172.21.15.167:0/1975000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 msgr2=0x7fa9e813d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 --2- 172.21.15.167:0/1975000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e813d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 -- 172.21.15.167:0/1975000428 >> v2:172.21.15.190:3300/0 conn(0x7fa9e8098a40 msgr2=0x7fa9e8143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:51.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 --2- 172.21.15.167:0/1975000428 >> v2:172.21.15.190:3300/0 conn(0x7fa9e8098a40 0x7fa9e8143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e77fe640 1 -- 172.21.15.167:0/1975000428 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80b45e0 con 0x7fa9e809a7b0 2024-09-13T17:24:51.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.878+0000 7fa9e6ffd640 1 --2- 172.21.15.167:0/1975000428 >> v2:172.21.15.190:3300/0 conn(0x7fa9e8098a40 0x7fa9e8143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:51.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9e77fe640 1 --2- 172.21.15.167:0/1975000428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e809a7b0 0x7fa9e809ab90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa9e81449d0 tx=0x7fa9d801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e96adc472a604 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9e67fc640 1 -- 172.21.15.167:0/1975000428 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80ab600 con 0x7fa9e809a7b0 2024-09-13T17:24:51.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9e67fc640 1 -- 172.21.15.167:0/1975000428 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80a7050 con 0x7fa9e809a7b0 2024-09-13T17:24:51.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9e67fc640 1 -- 172.21.15.167:0/1975000428 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80ab980 con 0x7fa9e809a7b0 2024-09-13T17:24:51.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 -- 172.21.15.167:0/1975000428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e809a7b0 msgr2=0x7fa9e809ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 --2- 172.21.15.167:0/1975000428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e809a7b0 0x7fa9e809ab90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa9e81449d0 tx=0x7fa9d801c490 comp rx=0 tx=0).stop 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 -- 172.21.15.167:0/1975000428 shutdown_connections 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 --2- 172.21.15.167:0/1975000428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e813d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 --2- 172.21.15.167:0/1975000428 >> v2:172.21.15.190:3300/0 conn(0x7fa9e8098a40 0x7fa9e8143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 --2- 172.21.15.167:0/1975000428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e809a7b0 0x7fa9e809ab90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 -- 172.21.15.167:0/1975000428 >> 172.21.15.167:0/1975000428 conn(0x7fa9e80b4db0 msgr2=0x7fa9e80b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 -- 172.21.15.167:0/1975000428 shutdown_connections 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.902+0000 7fa9edd30640 1 -- 172.21.15.167:0/1975000428 wait complete. 2024-09-13T17:24:51.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 Processor -- start 2024-09-13T17:24:51.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 -- start start 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e8098a40 0x7fa9e8146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e809a7b0 0x7fa9e813f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e81dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e81dc250 con 0x7fa9e8098a40 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e813f850 con 0x7fa9e809a7b0 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e813e560 con 0x7fa9e8144130 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e8098a40 0x7fa9e8146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e8098a40 0x7fa9e8146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43934/0 (socket says 172.21.15.167:43934) 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 -- 172.21.15.167:0/907548026 learned_addr learned my addr 172.21.15.167:0/907548026 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:51.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e7fff640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e81dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e6ffd640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e809a7b0 0x7fa9e813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 -- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 msgr2=0x7fa9e81dfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e81dfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 -- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e809a7b0 msgr2=0x7fa9e813f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e809a7b0 0x7fa9e813f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 -- 172.21.15.167:0/907548026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80094d0 con 0x7fa9e8098a40 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e7fff640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e81dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e6ffd640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e809a7b0 0x7fa9e813f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9e77fe640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e8098a40 0x7fa9e8146290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9d801cd30 tx=0x7fa9d8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9cffff640 1 -- 172.21.15.167:0/907548026 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80ac220 con 0x7fa9e8098a40 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9cffff640 1 -- 172.21.15.167:0/907548026 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80aa5b0 con 0x7fa9e8098a40 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e813fa90 con 0x7fa9e8098a40 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9cffff640 1 -- 172.21.15.167:0/907548026 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80aa960 con 0x7fa9e8098a40 2024-09-13T17:24:51.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e813e280 con 0x7fa9e8098a40 2024-09-13T17:24:51.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.906+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e8099b20 con 0x7fa9e8098a40 2024-09-13T17:24:51.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.910+0000 7fa9cffff640 1 -- 172.21.15.167:0/907548026 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9d80b2070 con 0x7fa9e8098a40 2024-09-13T17:24:51.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.910+0000 7fa9cffff640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa9d4066690 0x7fa9d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.910+0000 7fa9cffff640 1 -- 172.21.15.167:0/907548026 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa9d811e430 con 0x7fa9e8098a40 2024-09-13T17:24:51.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.910+0000 7fa9e6ffd640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa9d4066690 0x7fa9d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.910+0000 7fa9e6ffd640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa9d4066690 0x7fa9d4068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc006fd0 tx=0x7fa9dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:51.914+0000 7fa9cffff640 1 -- 172.21.15.167:0/907548026 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9d80eb3b0 con 0x7fa9e8098a40 2024-09-13T17:24:52.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.066+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9e8147c10 con 0x7fa9e8098a40 2024-09-13T17:24:52.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9cffff640 1 -- 172.21.15.167:0/907548026 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18815 (secure 0 0 0) 0x7fa9d80ee9d0 con 0x7fa9e8098a40 2024-09-13T17:24:52.072 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:24:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":29,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:21:32.702162+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:52.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa9d4066690 msgr2=0x7fa9d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa9d4066690 0x7fa9d4068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc006fd0 tx=0x7fa9dc008040 comp rx=0 tx=0).stop 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e8098a40 msgr2=0x7fa9e8146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e8098a40 0x7fa9e8146290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9d801cd30 tx=0x7fa9d8019230 comp rx=0 tx=0).stop 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 shutdown_connections 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa9d4066690 0x7fa9d4068b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa9e8144130 0x7fa9e81dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9e809a7b0 0x7fa9e813f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 --2- 172.21.15.167:0/907548026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9e8098a40 0x7fa9e8146290 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 >> 172.21.15.167:0/907548026 conn(0x7fa9e80b4db0 msgr2=0x7fa9e813b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 shutdown_connections 2024-09-13T17:24:52.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.070+0000 7fa9edd30640 1 -- 172.21.15.167:0/907548026 wait complete. 2024-09-13T17:24:52.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:20:49.286397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:20:49.932204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:20:52.990224+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:52.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:52.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.234+0000 7f16ca30e640 1 Processor -- start 2024-09-13T17:24:52.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.234+0000 7f16ca30e640 1 -- start start 2024-09-13T17:24:52.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16ca30e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16c4071130 0x7f16c406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16ca30e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c406bad0 con 0x7f16c40b4f00 2024-09-13T17:24:52.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16ca30e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c41463e0 con 0x7f16c406c4c0 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16ca30e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c41466c0 con 0x7f16c4071130 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16c4071130 0x7f16c406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16c4071130 0x7f16c406c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43946/0 (socket says 172.21.15.167:43946) 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c88ab640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f16c40b4f00 0x7f16c40b5310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52076/0 (socket says 172.21.15.167:52076) 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c37fe640 1 -- 172.21.15.167:0/1552773967 learned_addr learned my addr 172.21.15.167:0/1552773967 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c37fe640 1 -- 172.21.15.167:0/1552773967 >> v1:172.21.15.190:6789/0 conn(0x7f16c406c4c0 legacy=0x7f16c4070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c37fe640 1 -- 172.21.15.167:0/1552773967 >> v1:172.21.15.167:6789/0 conn(0x7f16c40b4f00 legacy=0x7f16c40b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c37fe640 1 -- 172.21.15.167:0/1552773967 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c41469a0 con 0x7f16c4071130 2024-09-13T17:24:52.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c37fe640 1 --2- 172.21.15.167:0/1552773967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4071130 0x7f16c406c8a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009870 tx=0x7f16b801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe70374af8bf33ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c2ffd640 1 -- 172.21.15.167:0/1552773967 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80aa610 con 0x7f16c4071130 2024-09-13T17:24:52.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c2ffd640 1 -- 172.21.15.167:0/1552773967 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b80a6040 con 0x7f16c4071130 2024-09-13T17:24:52.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.238+0000 7f16c2ffd640 1 -- 172.21.15.167:0/1552773967 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80aa990 con 0x7f16c4071130 2024-09-13T17:24:52.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/1552773967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4071130 msgr2=0x7f16c406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 --2- 172.21.15.167:0/1552773967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4071130 0x7f16c406c8a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009870 tx=0x7f16b801c490 comp rx=0 tx=0).stop 2024-09-13T17:24:52.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/1552773967 shutdown_connections 2024-09-13T17:24:52.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 --2- 172.21.15.167:0/1552773967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4071130 0x7f16c406c8a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/1552773967 >> 172.21.15.167:0/1552773967 conn(0x7f16c40b5dc0 msgr2=0x7f16c40b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/1552773967 shutdown_connections 2024-09-13T17:24:52.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/1552773967 wait complete. 2024-09-13T17:24:52.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 Processor -- start 2024-09-13T17:24:52.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- start start 2024-09-13T17:24:52.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16c406c4c0 0x7f16c409abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16c4071130 0x7f16c41de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c40b4f00 0x7f16c41decf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c409b0f0 con 0x7f16c40b4f00 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40b0f00 con 0x7f16c4071130 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41de320 con 0x7f16c406c4c0 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c40b4f00 0x7f16c41decf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c40b4f00 0x7f16c41decf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43956/0 (socket says 172.21.15.167:43956) 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 -- 172.21.15.167:0/734133693 learned_addr learned my addr 172.21.15.167:0/734133693 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c37fe640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16c4071130 0x7f16c41de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c3fff640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16c406c4c0 0x7f16c409abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 -- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16c406c4c0 msgr2=0x7f16c409abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16c406c4c0 0x7f16c409abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 -- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16c4071130 msgr2=0x7f16c41de7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16c4071130 0x7f16c41de7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 -- 172.21.15.167:0/734133693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80094d0 con 0x7f16c40b4f00 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c3fff640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16c406c4c0 0x7f16c409abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c37fe640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16c4071130 0x7f16c41de7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c88ab640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c40b4f00 0x7f16c41decf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c700 tx=0x7f16bc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c0ff9640 1 -- 172.21.15.167:0/734133693 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00ce10 con 0x7f16c40b4f00 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c0ff9640 1 -- 172.21.15.167:0/734133693 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc00a640 con 0x7f16c40b4f00 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c40b1130 con 0x7f16c40b4f00 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16c0ff9640 1 -- 172.21.15.167:0/734133693 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00a9b0 con 0x7f16c40b4f00 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c409b5c0 con 0x7f16c40b4f00 2024-09-13T17:24:52.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.242+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c41de490 con 0x7f16c40b4f00 2024-09-13T17:24:52.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.246+0000 7f16c0ff9640 1 -- 172.21.15.167:0/734133693 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16bc00ab10 con 0x7f16c40b4f00 2024-09-13T17:24:52.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.246+0000 7f16c0ff9640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f16b0066690 0x7f16b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.246+0000 7f16c0ff9640 1 -- 172.21.15.167:0/734133693 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f16bc083b70 con 0x7f16c40b4f00 2024-09-13T17:24:52.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.246+0000 7f16c3fff640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f16b0066690 0x7f16b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.246+0000 7f16c3fff640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f16b0066690 0x7f16b0068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16b4003e40 tx=0x7f16b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.250+0000 7f16c0ff9640 1 -- 172.21.15.167:0/734133693 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16bc0546d0 con 0x7f16c40b4f00 2024-09-13T17:24:52.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:52.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.394+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16c406c8a0 con 0x7f16c40b4f00 2024-09-13T17:24:52.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16c0ff9640 1 -- 172.21.15.167:0/734133693 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16bc017020 con 0x7f16c40b4f00 2024-09-13T17:24:52.401 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:24:52.403 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:52.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f16b0066690 msgr2=0x7f16b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f16b0066690 0x7f16b0068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16b4003e40 tx=0x7f16b4009040 comp rx=0 tx=0).stop 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c40b4f00 msgr2=0x7f16c41decf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c40b4f00 0x7f16c41decf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c700 tx=0x7f16bc00cbc0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 shutdown_connections 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f16b0066690 0x7f16b0068b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c40b4f00 0x7f16c41decf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16c4071130 0x7f16c41de7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 --2- 172.21.15.167:0/734133693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16c406c4c0 0x7f16c409abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 >> 172.21.15.167:0/734133693 conn(0x7f16c40b5dc0 msgr2=0x7f16c40af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 shutdown_connections 2024-09-13T17:24:52.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.398+0000 7f16ca30e640 1 -- 172.21.15.167:0/734133693 wait complete. 2024-09-13T17:24:52.419 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:52.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f846a85d640 1 Processor -- start 2024-09-13T17:24:52.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f846a85d640 1 -- start start 2024-09-13T17:24:52.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f846a85d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8464141090 0x7f8464070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f846a85d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 0x7f8464070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f846a85d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8464072300 con 0x7f84640b4210 2024-09-13T17:24:52.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f846a85d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8464144320 con 0x7f8464141090 2024-09-13T17:24:52.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f846a85d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8464144600 con 0x7f84640b45f0 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8463fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f84640b4210 0x7f8464140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52078/0 (socket says 172.21.15.167:52078) 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8463fff640 1 -- 172.21.15.167:0/2376276036 learned_addr learned my addr 172.21.15.167:0/2376276036 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947309756 0 0) 0x7f8464072300 con 0x7f84640b4210 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8450003530 con 0x7f84640b4210 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f84637fe640 1 --2- 172.21.15.167:0/2376276036 >> v2:172.21.15.190:3300/0 conn(0x7f8464141090 0x7f8464070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8468dfa640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 0x7f8464070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773951184 0 0) 0x7f8450003530 con 0x7f84640b4210 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 msgr2=0x7f8464070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 0x7f8464070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 >> v2:172.21.15.190:3300/0 conn(0x7f8464141090 msgr2=0x7f8464070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 --2- 172.21.15.167:0/2376276036 >> v2:172.21.15.190:3300/0 conn(0x7f8464141090 0x7f8464070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846406e890 con 0x7f84640b4210 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f845c001680 con 0x7f84640b4210 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 >> v1:172.21.15.167:6789/0 conn(0x7f84640b4210 legacy=0x7f8464140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8450003980 0x7f8450003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f8450004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 0x7f8450005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8464144320 con 0x7f84500047d0 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8464144600 con 0x7f8450003980 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845000bb20 con 0x7f84640b45f0 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f84637fe640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f8450004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8463fff640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8450003980 0x7f8450003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8468dfa640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 0x7f8450005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f84637fe640 1 -- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 msgr2=0x7f8450005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f84637fe640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 0x7f8450005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f84637fe640 1 -- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8450003980 msgr2=0x7f8450003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f84637fe640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8450003980 0x7f8450003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f84637fe640 1 -- 172.21.15.167:0/2376276036 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450003530 con 0x7f84500047d0 2024-09-13T17:24:52.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.622+0000 7f8468dfa640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84640b45f0 0x7f8450005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:52.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f84637fe640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f8450004c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84641414b0 tx=0x7f844c01c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de3da86bcb2ad86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0ad410 con 0x7f84500047d0 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0a7030 con 0x7f84500047d0 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8462ffd640 1 -- 172.21.15.167:0/2376276036 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0ad5b0 con 0x7f84500047d0 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- 172.21.15.167:0/2376276036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 msgr2=0x7f8450004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 --2- 172.21.15.167:0/2376276036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f8450004c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84641414b0 tx=0x7f844c01c5a0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8468dfa640 1 -- 172.21.15.167:0/2376276036 reap_dead start 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- 172.21.15.167:0/2376276036 shutdown_connections 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- 172.21.15.167:0/2376276036 >> 172.21.15.167:0/2376276036 conn(0x7f846409b150 msgr2=0x7f846409b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- 172.21.15.167:0/2376276036 shutdown_connections 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- 172.21.15.167:0/2376276036 wait complete. 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 Processor -- start 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- start start 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846409c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f846409cbf0 0x7f84641d8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84641d8890 0x7f84641470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84641d8d10 con 0x7f84500047d0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84641df1b0 con 0x7f846409cbf0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f846a85d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84641df490 con 0x7f84641d8890 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846409c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846409c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43962/0 (socket says 172.21.15.167:43962) 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 -- 172.21.15.167:0/585155886 learned_addr learned my addr 172.21.15.167:0/585155886 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8468dfa640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84641d8890 0x7f84641470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 -- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84641d8890 msgr2=0x7f84641470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f84637fe640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f846409cbf0 0x7f84641d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84641d8890 0x7f84641470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 -- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f846409cbf0 msgr2=0x7f84641d8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f846409cbf0 0x7f84641d8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.626+0000 7f8463fff640 1 -- 172.21.15.167:0/585155886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84641df770 con 0x7f84500047d0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f8463fff640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846409c6b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f845c001cd0 tx=0x7f845c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f8460ff9640 1 -- 172.21.15.167:0/585155886 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c004a00 con 0x7f84500047d0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f8460ff9640 1 -- 172.21.15.167:0/585155886 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c004b60 con 0x7f84500047d0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846413d760 con 0x7f84500047d0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f8460ff9640 1 -- 172.21.15.167:0/585155886 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c005050 con 0x7f84500047d0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84641477b0 con 0x7f84500047d0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84641df9b0 con 0x7f84500047d0 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f8460ff9640 1 -- 172.21.15.167:0/585155886 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f845c0051b0 con 0x7f84500047d0 2024-09-13T17:24:52.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f8460ff9640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8444066690 0x7f8444068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f84637fe640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8444066690 0x7f8444068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f8460ff9640 1 -- 172.21.15.167:0/585155886 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f845c084140 con 0x7f84500047d0 2024-09-13T17:24:52.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.630+0000 7f84637fe640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8444066690 0x7f8444068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f844c0af000 tx=0x7f844c0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.634+0000 7f8460ff9640 1 -- 172.21.15.167:0/585155886 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f84641df9b0 con 0x7f84500047d0 2024-09-13T17:24:52.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.794+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84641df9b0 con 0x7f84500047d0 2024-09-13T17:24:52.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.794+0000 7f8460ff9640 1 -- 172.21.15.167:0/585155886 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f845c019020 con 0x7f84500047d0 2024-09-13T17:24:52.800 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:24:52.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8444066690 msgr2=0x7f8444068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8444066690 0x7f8444068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f844c0af000 tx=0x7f844c0046d0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 msgr2=0x7f846409c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846409c6b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f845c001cd0 tx=0x7f845c00ed70 comp rx=0 tx=0).stop 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 shutdown_connections 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8444066690 0x7f8444068b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84641d8890 0x7f84641470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f846409cbf0 0x7f84641d8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 --2- 172.21.15.167:0/585155886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846409c6b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 >> 172.21.15.167:0/585155886 conn(0x7f846409b150 msgr2=0x7f846406d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 shutdown_connections 2024-09-13T17:24:52.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.798+0000 7f846a85d640 1 -- 172.21.15.167:0/585155886 wait complete. 2024-09-13T17:24:52.819 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:52.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.938+0000 7fb2ce01f640 1 Processor -- start 2024-09-13T17:24:52.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.938+0000 7fb2ce01f640 1 -- start start 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2ce01f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb2c80b3530 0x7fb2c809cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2ce01f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c8098a40 0x7fb2c8143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2ce01f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c8144490 con 0x7fb2c8143fe0 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2ce01f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c809b090 con 0x7fb2c80b3530 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2ce01f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80b3910 con 0x7fb2c8098a40 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb2c80b3530 0x7fb2c809cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb2c80b3530 0x7fb2c809cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43968/0 (socket says 172.21.15.167:43968) 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c77fe640 1 -- 172.21.15.167:0/123528954 learned_addr learned my addr 172.21.15.167:0/123528954 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c6ffd640 1 --2- 172.21.15.167:0/123528954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c8098a40 0x7fb2c8143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c77fe640 1 -- 172.21.15.167:0/123528954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c8098a40 msgr2=0x7fb2c8143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c77fe640 1 --2- 172.21.15.167:0/123528954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c8098a40 0x7fb2c8143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c77fe640 1 -- 172.21.15.167:0/123528954 >> v1:172.21.15.190:6789/0 conn(0x7fb2c8143fe0 legacy=0x7fb2c8146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c77fe640 1 -- 172.21.15.167:0/123528954 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8099490 con 0x7fb2c80b3530 2024-09-13T17:24:52.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.942+0000 7fb2c6ffd640 1 --2- 172.21.15.167:0/123528954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c8098a40 0x7fb2c8143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:52.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c77fe640 1 --2- 172.21.15.167:0/123528954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c80b3530 0x7fb2c809cd00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009870 tx=0x7fb2bc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de4d0149a9ff9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c67fc640 1 -- 172.21.15.167:0/123528954 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0ac630 con 0x7fb2c80b3530 2024-09-13T17:24:52.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c67fc640 1 -- 172.21.15.167:0/123528954 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc0ac790 con 0x7fb2c80b3530 2024-09-13T17:24:52.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c67fc640 1 -- 172.21.15.167:0/123528954 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0acb20 con 0x7fb2c80b3530 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- 172.21.15.167:0/123528954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c80b3530 msgr2=0x7fb2c809cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/123528954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c80b3530 0x7fb2c809cd00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009870 tx=0x7fb2bc01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- 172.21.15.167:0/123528954 shutdown_connections 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/123528954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c8098a40 0x7fb2c8143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/123528954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c80b3530 0x7fb2c809cd00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- 172.21.15.167:0/123528954 >> 172.21.15.167:0/123528954 conn(0x7fb2c80b3b50 msgr2=0x7fb2c80b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- 172.21.15.167:0/123528954 shutdown_connections 2024-09-13T17:24:52.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- 172.21.15.167:0/123528954 wait complete. 2024-09-13T17:24:52.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 Processor -- start 2024-09-13T17:24:52.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- start start 2024-09-13T17:24:52.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c80b3530 0x7fb2c8070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c8143fe0 0x7fb2c813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2c813f680 0x7fb2c813e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c8140af0 con 0x7fb2c8143fe0 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c8140800 con 0x7fb2c813f680 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80af610 con 0x7fb2c80b3530 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c8143fe0 0x7fb2c813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c8143fe0 0x7fb2c813e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43978/0 (socket says 172.21.15.167:43978) 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 -- 172.21.15.167:0/664772533 learned_addr learned my addr 172.21.15.167:0/664772533 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c77fe640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c80b3530 0x7fb2c8070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c7fff640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2c813f680 0x7fb2c813e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 -- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c80b3530 msgr2=0x7fb2c8070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c80b3530 0x7fb2c8070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 -- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2c813f680 msgr2=0x7fb2c813e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2c813f680 0x7fb2c813e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 -- 172.21.15.167:0/664772533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0094d0 con 0x7fb2c8143fe0 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c77fe640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c80b3530 0x7fb2c8070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c7fff640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2c813f680 0x7fb2c813e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2c6ffd640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c8143fe0 0x7fb2c813e0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800c7f0 tx=0x7fb2b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2affff640 1 -- 172.21.15.167:0/664772533 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800cea0 con 0x7fb2c8143fe0 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2affff640 1 -- 172.21.15.167:0/664772533 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b8007a30 con 0x7fb2c8143fe0 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c8141000 con 0x7fb2c8143fe0 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2affff640 1 -- 172.21.15.167:0/664772533 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8007de0 con 0x7fb2c8143fe0 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.946+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c813fe20 con 0x7fb2c8143fe0 2024-09-13T17:24:52.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.950+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c8143aa0 con 0x7fb2c8143fe0 2024-09-13T17:24:52.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.950+0000 7fb2affff640 1 -- 172.21.15.167:0/664772533 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb2b80113f0 con 0x7fb2c8143fe0 2024-09-13T17:24:52.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.950+0000 7fb2affff640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb2b4066690 0x7fb2b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.950+0000 7fb2affff640 1 -- 172.21.15.167:0/664772533 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb2b8084630 con 0x7fb2c8143fe0 2024-09-13T17:24:52.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.950+0000 7fb2c77fe640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb2b4066690 0x7fb2b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.950+0000 7fb2c77fe640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb2b4066690 0x7fb2b4068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0ae000 tx=0x7fb2bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:52.954+0000 7fb2affff640 1 -- 172.21.15.167:0/664772533 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb2b8051650 con 0x7fb2c8143fe0 2024-09-13T17:24:53.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2c8142fd0 con 0x7fb2c8143fe0 2024-09-13T17:24:53.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2affff640 1 -- 172.21.15.167:0/664772533 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2b8054c70 con 0x7fb2c8143fe0 2024-09-13T17:24:53.105 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2024-09-13T17:24:53.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb2b4066690 msgr2=0x7fb2b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb2b4066690 0x7fb2b4068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0ae000 tx=0x7fb2bc008040 comp rx=0 tx=0).stop 2024-09-13T17:24:53.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c8143fe0 msgr2=0x7fb2c813e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c8143fe0 0x7fb2c813e0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800c7f0 tx=0x7fb2b800ccb0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 shutdown_connections 2024-09-13T17:24:53.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb2b4066690 0x7fb2b4068b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2c813f680 0x7fb2c813e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c8143fe0 0x7fb2c813e0c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 --2- 172.21.15.167:0/664772533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2c80b3530 0x7fb2c8070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 >> 172.21.15.167:0/664772533 conn(0x7fb2c80b3b50 msgr2=0x7fb2c8142650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:53.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 shutdown_connections 2024-09-13T17:24:53.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.102+0000 7fb2ce01f640 1 -- 172.21.15.167:0/664772533 wait complete. 2024-09-13T17:24:53.123 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:53.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.226+0000 7f8882ced640 1 Processor -- start 2024-09-13T17:24:53.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.226+0000 7f8882ced640 1 -- start start 2024-09-13T17:24:53.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.226+0000 7f8882ced640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c098a40 0x7f887c143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.226+0000 7f8882ced640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c144490 con 0x7f887c143fe0 2024-09-13T17:24:53.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.226+0000 7f8882ced640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c09d410 con 0x7f887c0b3530 2024-09-13T17:24:53.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.226+0000 7f8882ced640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c09b090 con 0x7f887c098a40 2024-09-13T17:24:53.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f888128a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f887c143fe0 0x7f887c14dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52082/0 (socket says 172.21.15.167:52082) 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f888128a640 1 -- 172.21.15.167:0/2173744477 learned_addr learned my addr 172.21.15.167:0/2173744477 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c098a40 0x7f887c143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584267033 0 0) 0x7f887c144490 con 0x7f887c143fe0 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8864003530 con 0x7f887c143fe0 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059854500 0 0) 0x7f8864003530 con 0x7f887c143fe0 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c098a40 msgr2=0x7f887c143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c098a40 0x7f887c143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 >> v1:172.21.15.190:6789/0 conn(0x7f887c0b3530 legacy=0x7f887c09cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0b3910 con 0x7f887c143fe0 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f8874001a00 con 0x7f887c143fe0 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 >> v1:172.21.15.167:6789/0 conn(0x7f887c143fe0 legacy=0x7f887c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640039b0 0x7f8864003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88640047d0 0x7f8864004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8864005190 0x7f886400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c09b090 con 0x7f88640047d0 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886400bed0 con 0x7f88640039b0 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886400c010 con 0x7f8864005190 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88640047d0 0x7f8864004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8880a89640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640039b0 0x7f8864003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 -- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8864005190 msgr2=0x7f886400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8864005190 0x7f886400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 -- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640039b0 msgr2=0x7f8864003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640039b0 0x7f8864003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 -- 172.21.15.167:0/2173744477 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864003530 con 0x7f88640047d0 2024-09-13T17:24:53.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8880a89640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640039b0 0x7f8864003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:53.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887bfff640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88640047d0 0x7f8864004c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f887c09a880 tx=0x7f886c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa99bf071d35e1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0a5640 con 0x7f88640047d0 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c0a57a0 con 0x7f88640047d0 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f887b7fe640 1 -- 172.21.15.167:0/2173744477 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0a5b10 con 0x7f88640047d0 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8882ced640 1 -- 172.21.15.167:0/2173744477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88640047d0 msgr2=0x7f8864004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8882ced640 1 --2- 172.21.15.167:0/2173744477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88640047d0 0x7f8864004c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f887c09a880 tx=0x7f886c01c9f0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f888128a640 1 -- 172.21.15.167:0/2173744477 reap_dead start 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8882ced640 1 -- 172.21.15.167:0/2173744477 shutdown_connections 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8882ced640 1 -- 172.21.15.167:0/2173744477 >> 172.21.15.167:0/2173744477 conn(0x7f887c0b3b50 msgr2=0x7f887c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8882ced640 1 -- 172.21.15.167:0/2173744477 shutdown_connections 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.230+0000 7f8882ced640 1 -- 172.21.15.167:0/2173744477 wait complete. 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 Processor -- start 2024-09-13T17:24:53.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 -- start start 2024-09-13T17:24:53.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640047d0 0x7f887c1dc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c140db0 0x7f887c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c0afc60 0x7f887c138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c139700 con 0x7f887c140db0 2024-09-13T17:24:53.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c139f20 con 0x7f88640047d0 2024-09-13T17:24:53.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c1dc690 con 0x7f887c0afc60 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c140db0 0x7f887c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c140db0 0x7f887c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44002/0 (socket says 172.21.15.167:44002) 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 -- 172.21.15.167:0/1243777793 learned_addr learned my addr 172.21.15.167:0/1243777793 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8880a89640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640047d0 0x7f887c1dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f888128a640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c0afc60 0x7f887c138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 -- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c0afc60 msgr2=0x7f887c138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c0afc60 0x7f887c138790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 -- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640047d0 msgr2=0x7f887c1dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640047d0 0x7f887c1dc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 -- 172.21.15.167:0/1243777793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0b0110 con 0x7f887c140db0 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8880a89640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640047d0 0x7f887c1dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f887bfff640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c140db0 0x7f887c0af720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f886c0b0040 tx=0x7f8864005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f88797fa640 1 -- 172.21.15.167:0/1243777793 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0bc070 con 0x7f887c140db0 2024-09-13T17:24:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f88797fa640 1 -- 172.21.15.167:0/1243777793 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c0b8440 con 0x7f887c140db0 2024-09-13T17:24:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c1dc880 con 0x7f887c140db0 2024-09-13T17:24:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f88797fa640 1 -- 172.21.15.167:0/1243777793 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0b87f0 con 0x7f887c140db0 2024-09-13T17:24:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c0715b0 con 0x7f887c140db0 2024-09-13T17:24:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c09d280 con 0x7f887c140db0 2024-09-13T17:24:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.234+0000 7f88797fa640 1 -- 172.21.15.167:0/1243777793 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f886c0b4040 con 0x7f887c140db0 2024-09-13T17:24:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.238+0000 7f88797fa640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8868066690 0x7f8868068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.238+0000 7f88797fa640 1 -- 172.21.15.167:0/1243777793 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f886c11e1f0 con 0x7f887c140db0 2024-09-13T17:24:53.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.238+0000 7f8880a89640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8868066690 0x7f8868068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.238+0000 7f8880a89640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8868066690 0x7f8868068b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8870007fd0 tx=0x7f8870009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.242+0000 7f88797fa640 1 -- 172.21.15.167:0/1243777793 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f886c0eb210 con 0x7f887c140db0 2024-09-13T17:24:53.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f887c099c20 con 0x7f887c140db0 2024-09-13T17:24:53.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f88797fa640 1 -- 172.21.15.167:0/1243777793 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f886c0ee830 con 0x7f887c140db0 2024-09-13T17:24:53.401 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8868066690 msgr2=0x7f8868068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8868066690 0x7f8868068b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8870007fd0 tx=0x7f8870009040 comp rx=0 tx=0).stop 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c140db0 msgr2=0x7f887c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c140db0 0x7f887c0af720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f886c0b0040 tx=0x7f8864005800 comp rx=0 tx=0).stop 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 shutdown_connections 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8868066690 0x7f8868068b50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f887c0afc60 0x7f887c138790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c140db0 0x7f887c0af720 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 --2- 172.21.15.167:0/1243777793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88640047d0 0x7f887c1dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 >> 172.21.15.167:0/1243777793 conn(0x7f887c0b3b50 msgr2=0x7f887c06b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 shutdown_connections 2024-09-13T17:24:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.398+0000 7f8882ced640 1 -- 172.21.15.167:0/1243777793 wait complete. 2024-09-13T17:24:53.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:24:53.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb616711640 1 Processor -- start 2024-09-13T17:24:53.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb616711640 1 -- start start 2024-09-13T17:24:53.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb616711640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb6100ace60 0x7fb61014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb616711640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100ae000 con 0x7fb610071d00 2024-09-13T17:24:53.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb616711640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100ad290 con 0x7fb6100aca80 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb616711640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100b2c00 con 0x7fb6100ace60 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb610071d00 0x7fb61009cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52084/0 (socket says 172.21.15.167:52084) 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2248815336 learned_addr learned my addr 172.21.15.167:0/2248815336 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb614cae640 1 --2- 172.21.15.167:0/2248815336 >> v2:172.21.15.190:3300/0 conn(0x7fb6100ace60 0x7fb61014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536165723 0 0) 0x7fb6100ae000 con 0x7fb610071d00 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc003530 con 0x7fb610071d00 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148736959 0 0) 0x7fb5fc003530 con 0x7fb610071d00 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 >> v2:172.21.15.190:3300/0 conn(0x7fb6100ace60 msgr2=0x7fb61014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 --2- 172.21.15.167:0/2248815336 >> v2:172.21.15.190:3300/0 conn(0x7fb6100ace60 0x7fb61014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 >> v1:172.21.15.190:6789/0 conn(0x7fb6100aca80 legacy=0x7fb6100b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610145cb0 con 0x7fb610071d00 2024-09-13T17:24:53.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fb5f8001a20 con 0x7fb610071d00 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 >> v1:172.21.15.167:6789/0 conn(0x7fb610071d00 legacy=0x7fb61009cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc003980 0x7fb5fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5fc0047d0 0x7fb5fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc005190 0x7fb5fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100b2c00 con 0x7fb5fc0047d0 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc00c130 con 0x7fb5fc005190 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc00c2f0 con 0x7fb5fc003980 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5fc0047d0 0x7fb5fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60ffff640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc003980 0x7fb5fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb614cae640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc005190 0x7fb5fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc003980 msgr2=0x7fb5fc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc003980 0x7fb5fc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc005190 msgr2=0x7fb5fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc005190 0x7fb5fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2248815336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc003530 con 0x7fb5fc0047d0 2024-09-13T17:24:53.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb60ffff640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc003980 0x7fb5fc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:53.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb614cae640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5fc005190 0x7fb5fc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:53.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.538+0000 7fb614cae640 1 -- 172.21.15.167:0/2248815336 reap_dead start 2024-09-13T17:24:53.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb60f7fe640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5fc0047d0 0x7fb5fc004c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb6100ae190 tx=0x7fb5f801d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d7d5f5eae21ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80ad630 con 0x7fb5fc0047d0 2024-09-13T17:24:53.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f80a8070 con 0x7fb5fc0047d0 2024-09-13T17:24:53.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb60effd640 1 -- 172.21.15.167:0/2248815336 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80ad9d0 con 0x7fb5fc0047d0 2024-09-13T17:24:53.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 -- 172.21.15.167:0/2248815336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5fc0047d0 msgr2=0x7fb5fc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5fc0047d0 0x7fb5fc004c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb6100ae190 tx=0x7fb5f801d2f0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 -- 172.21.15.167:0/2248815336 shutdown_connections 2024-09-13T17:24:53.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 --2- 172.21.15.167:0/2248815336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5fc0047d0 0x7fb5fc004c50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 -- 172.21.15.167:0/2248815336 >> 172.21.15.167:0/2248815336 conn(0x7fb6100b3b50 msgr2=0x7fb6100b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:53.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 -- 172.21.15.167:0/2248815336 shutdown_connections 2024-09-13T17:24:53.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 -- 172.21.15.167:0/2248815336 wait complete. 2024-09-13T17:24:53.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 Processor -- start 2024-09-13T17:24:53.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.542+0000 7fb616711640 1 -- start start 2024-09-13T17:24:53.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc0047d0 0x7fb610140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6101419e0 0x7fb6101da040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb610141e20 0x7fb6101da580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb610142fc0 con 0x7fb6101419e0 2024-09-13T17:24:53.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb610142980 con 0x7fb610141e20 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6101d9bf0 con 0x7fb5fc0047d0 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6101419e0 0x7fb6101da040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6101419e0 0x7fb6101da040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44010/0 (socket says 172.21.15.167:44010) 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2108356444 learned_addr learned my addr 172.21.15.167:0/2108356444 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb614cae640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb610141e20 0x7fb6101da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60ffff640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc0047d0 0x7fb610140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc0047d0 msgr2=0x7fb610140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc0047d0 0x7fb610140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb610141e20 msgr2=0x7fb6101da580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb610141e20 0x7fb6101da580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 -- 172.21.15.167:0/2108356444 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6100b0ef0 con 0x7fb6101419e0 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60f7fe640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6101419e0 0x7fb6101da040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5f801d330 tx=0x7fb5fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60cff9640 1 -- 172.21.15.167:0/2108356444 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80018a0 con 0x7fb6101419e0 2024-09-13T17:24:53.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60cff9640 1 -- 172.21.15.167:0/2108356444 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f80a5e90 con 0x7fb6101419e0 2024-09-13T17:24:53.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb610142330 con 0x7fb6101419e0 2024-09-13T17:24:53.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60cff9640 1 -- 172.21.15.167:0/2108356444 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80ad650 con 0x7fb6101419e0 2024-09-13T17:24:53.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6101405b0 con 0x7fb6101419e0 2024-09-13T17:24:53.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6101405b0 con 0x7fb6101419e0 2024-09-13T17:24:53.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60cff9640 1 -- 172.21.15.167:0/2108356444 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5f80aa030 con 0x7fb6101419e0 2024-09-13T17:24:53.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60cff9640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb5f0066680 0x7fb5f0068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60ffff640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb5f0066680 0x7fb5f0068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60cff9640 1 -- 172.21.15.167:0/2108356444 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb5f811ea60 con 0x7fb6101419e0 2024-09-13T17:24:53.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.546+0000 7fb60ffff640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb5f0066680 0x7fb5f0068b40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb608000c10 tx=0x7fb608009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.550+0000 7fb60cff9640 1 -- 172.21.15.167:0/2108356444 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5f80eba80 con 0x7fb6101419e0 2024-09-13T17:24:53.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.710+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb6101405b0 con 0x7fb6101419e0 2024-09-13T17:24:53.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.710+0000 7fb60cff9640 1 -- 172.21.15.167:0/2108356444 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb5f80ef0a0 con 0x7fb6101419e0 2024-09-13T17:24:53.714 INFO:teuthology.orchestra.run.smithi167.stderr:listed 0 entries 2024-09-13T17:24:53.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb5f0066680 msgr2=0x7fb5f0068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb5f0066680 0x7fb5f0068b40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb608000c10 tx=0x7fb608009040 comp rx=0 tx=0).stop 2024-09-13T17:24:53.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6101419e0 msgr2=0x7fb6101da040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6101419e0 0x7fb6101da040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5f801d330 tx=0x7fb5fc005800 comp rx=0 tx=0).stop 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 shutdown_connections 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fb5f0066680 0x7fb5f0068b40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb610141e20 0x7fb6101da580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6101419e0 0x7fb6101da040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 --2- 172.21.15.167:0/2108356444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5fc0047d0 0x7fb610140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 >> 172.21.15.167:0/2108356444 conn(0x7fb6100b3b50 msgr2=0x7fb610098a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 shutdown_connections 2024-09-13T17:24:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.714+0000 7fb616711640 1 -- 172.21.15.167:0/2108356444 wait complete. 2024-09-13T17:24:53.733 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-13T17:24:53.733 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:53.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:53.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.890+0000 7f3309f4f640 1 Processor -- start 2024-09-13T17:24:53.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.890+0000 7f3309f4f640 1 -- start start 2024-09-13T17:24:53.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3309f4f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f330406f0f0 0x7f33040b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3309f4f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3304070ff0 0x7f330414e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3309f4f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3304071b10 con 0x7f3304070bb0 2024-09-13T17:24:53.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3309f4f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330406f7f0 con 0x7f3304070ff0 2024-09-13T17:24:53.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3309f4f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33040b0ea0 con 0x7f330406f0f0 2024-09-13T17:24:53.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3303fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3304070ff0 0x7f330414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3302ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3304070bb0 0x7f330413d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52086/0 (socket says 172.21.15.167:52086) 2024-09-13T17:24:53.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3302ffd640 1 -- 172.21.15.167:0/1928716806 learned_addr learned my addr 172.21.15.167:0/1928716806 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:53.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f33037fe640 1 --2- 172.21.15.167:0/1928716806 >> v2:172.21.15.190:3300/0 conn(0x7f330406f0f0 0x7f33040b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3303fff640 1 -- 172.21.15.167:0/1928716806 >> v2:172.21.15.190:3300/0 conn(0x7f330406f0f0 msgr2=0x7f33040b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3303fff640 1 --2- 172.21.15.167:0/1928716806 >> v2:172.21.15.190:3300/0 conn(0x7f330406f0f0 0x7f33040b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3303fff640 1 -- 172.21.15.167:0/1928716806 >> v1:172.21.15.167:6789/0 conn(0x7f3304070bb0 legacy=0x7f330413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f33027fc640 1 -- 172.21.15.167:0/1928716806 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399866493 0 0) 0x7f3304071b10 con 0x7f3304070bb0 2024-09-13T17:24:53.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3303fff640 1 -- 172.21.15.167:0/1928716806 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304071df0 con 0x7f3304070ff0 2024-09-13T17:24:53.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.894+0000 7f3303fff640 1 --2- 172.21.15.167:0/1928716806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f330414e160 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f33040679e0 tx=0x7f32f401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62e7678f043fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f33027fc640 1 -- 172.21.15.167:0/1928716806 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40ab600 con 0x7f3304070ff0 2024-09-13T17:24:53.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f33027fc640 1 -- 172.21.15.167:0/1928716806 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f40a7050 con 0x7f3304070ff0 2024-09-13T17:24:53.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f33027fc640 1 -- 172.21.15.167:0/1928716806 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40ab980 con 0x7f3304070ff0 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- 172.21.15.167:0/1928716806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 msgr2=0x7f330414e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 --2- 172.21.15.167:0/1928716806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f330414e160 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f33040679e0 tx=0x7f32f401c340 comp rx=0 tx=0).stop 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- 172.21.15.167:0/1928716806 shutdown_connections 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 --2- 172.21.15.167:0/1928716806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f330414e160 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 --2- 172.21.15.167:0/1928716806 >> v2:172.21.15.190:3300/0 conn(0x7f330406f0f0 0x7f33040b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- 172.21.15.167:0/1928716806 >> 172.21.15.167:0/1928716806 conn(0x7f33040b7250 msgr2=0x7f33040b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- 172.21.15.167:0/1928716806 shutdown_connections 2024-09-13T17:24:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- 172.21.15.167:0/1928716806 wait complete. 2024-09-13T17:24:53.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 Processor -- start 2024-09-13T17:24:53.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- start start 2024-09-13T17:24:53.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f330406f0f0 0x7f3304144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3304070bb0 0x7f3304147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f33041483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3304146560 con 0x7f3304070ff0 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3304149c40 con 0x7f330406f0f0 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3304149f20 con 0x7f3304070bb0 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f33041483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f33041483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44036/0 (socket says 172.21.15.167:44036) 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 -- 172.21.15.167:0/663458316 learned_addr learned my addr 172.21.15.167:0/663458316 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f33037fe640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f330406f0f0 0x7f3304144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3302ffd640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3304070bb0 0x7f3304147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 -- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3304070bb0 msgr2=0x7f3304147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3304070bb0 0x7f3304147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 -- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f330406f0f0 msgr2=0x7f3304144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f330406f0f0 0x7f3304144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 -- 172.21.15.167:0/663458316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009420 con 0x7f3304070ff0 2024-09-13T17:24:53.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3303fff640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f33041483b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32f4019f70 tx=0x7f32f401ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f32fbfff640 1 -- 172.21.15.167:0/663458316 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4004230 con 0x7f3304070ff0 2024-09-13T17:24:53.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f32fbfff640 1 -- 172.21.15.167:0/663458316 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4004390 con 0x7f3304070ff0 2024-09-13T17:24:53.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3304147120 con 0x7f3304070ff0 2024-09-13T17:24:53.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f32fbfff640 1 -- 172.21.15.167:0/663458316 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4003820 con 0x7f3304070ff0 2024-09-13T17:24:53.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.898+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3304149280 con 0x7f3304070ff0 2024-09-13T17:24:53.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.902+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33040b6e90 con 0x7f3304070ff0 2024-09-13T17:24:53.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.902+0000 7f32fbfff640 1 -- 172.21.15.167:0/663458316 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32f40b2050 con 0x7f3304070ff0 2024-09-13T17:24:53.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.902+0000 7f32fbfff640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f32e40666c0 0x7f32e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.902+0000 7f32fbfff640 1 -- 172.21.15.167:0/663458316 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f32f411e8e0 con 0x7f3304070ff0 2024-09-13T17:24:53.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.902+0000 7f33037fe640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f32e40666c0 0x7f32e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.902+0000 7f33037fe640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f32e40666c0 0x7f32e4068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f330413d530 tx=0x7f32fc0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:53.906+0000 7f32fbfff640 1 -- 172.21.15.167:0/663458316 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32f40eba20 con 0x7f3304070ff0 2024-09-13T17:24:54.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.054+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33040b6bb0 con 0x7f3304070ff0 2024-09-13T17:24:54.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f32fbfff640 1 -- 172.21.15.167:0/663458316 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18815 (secure 0 0 0) 0x7f32f40b0020 con 0x7f3304070ff0 2024-09-13T17:24:54.061 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:24:54.061 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":29,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:21:32.702162+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f32e40666c0 msgr2=0x7f32e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f32e40666c0 0x7f32e4068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f330413d530 tx=0x7f32fc0079a0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 msgr2=0x7f33041483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f33041483b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32f4019f70 tx=0x7f32f401ab80 comp rx=0 tx=0).stop 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 shutdown_connections 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f32e40666c0 0x7f32e4068b80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3304070ff0 0x7f33041483b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3304070bb0 0x7f3304147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 --2- 172.21.15.167:0/663458316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f330406f0f0 0x7f3304144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 >> 172.21.15.167:0/663458316 conn(0x7f33040b7250 msgr2=0x7f330413d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 shutdown_connections 2024-09-13T17:24:54.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.058+0000 7f3309f4f640 1 -- 172.21.15.167:0/663458316 wait complete. 2024-09-13T17:24:54.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:20:39.564342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:20:49.286397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:20:49.932204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:20:52.990224+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:54.080 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:54.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.194+0000 7f1829658640 1 Processor -- start 2024-09-13T17:24:54.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.194+0000 7f1829658640 1 -- start start 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f18240b3530 0x7f182409cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824098a40 0x7f1824143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1824143fe0 0x7f1824146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182409b090 con 0x7f1824143fe0 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1824144490 con 0x7f18240b3530 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18240b3910 con 0x7f1824098a40 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1824143fe0 0x7f1824146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1824143fe0 0x7f1824146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44052/0 (socket says 172.21.15.167:44052) 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 -- 172.21.15.167:0/1608175063 learned_addr learned my addr 172.21.15.167:0/1608175063 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:54.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18227fc640 1 --2- 172.21.15.167:0/1608175063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824098a40 0x7f1824143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1822ffd640 1 --2- 172.21.15.167:0/1608175063 >> v2:172.21.15.190:3300/0 conn(0x7f18240b3530 0x7f182409cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 -- 172.21.15.167:0/1608175063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824098a40 msgr2=0x7f1824143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:54.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 --2- 172.21.15.167:0/1608175063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824098a40 0x7f1824143aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 -- 172.21.15.167:0/1608175063 >> v2:172.21.15.190:3300/0 conn(0x7f18240b3530 msgr2=0x7f182409cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:54.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 --2- 172.21.15.167:0/1608175063 >> v2:172.21.15.190:3300/0 conn(0x7f18240b3530 0x7f182409cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 -- 172.21.15.167:0/1608175063 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824099490 con 0x7f1824143fe0 2024-09-13T17:24:54.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f18237fe640 1 --2- 172.21.15.167:0/1608175063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1824143fe0 0x7f1824146cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f182406c9a0 tx=0x7f181c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65653076970e5601 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1821ffb640 1 -- 172.21.15.167:0/1608175063 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0a5580 con 0x7f1824143fe0 2024-09-13T17:24:54.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1821ffb640 1 -- 172.21.15.167:0/1608175063 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c0a56e0 con 0x7f1824143fe0 2024-09-13T17:24:54.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1821ffb640 1 -- 172.21.15.167:0/1608175063 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0a5a70 con 0x7f1824143fe0 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- 172.21.15.167:0/1608175063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1824143fe0 msgr2=0x7f1824146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 --2- 172.21.15.167:0/1608175063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1824143fe0 0x7f1824146cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f182406c9a0 tx=0x7f181c01c700 comp rx=0 tx=0).stop 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- 172.21.15.167:0/1608175063 shutdown_connections 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 --2- 172.21.15.167:0/1608175063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1824143fe0 0x7f1824146cc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 --2- 172.21.15.167:0/1608175063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824098a40 0x7f1824143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 --2- 172.21.15.167:0/1608175063 >> v2:172.21.15.190:3300/0 conn(0x7f18240b3530 0x7f182409cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- 172.21.15.167:0/1608175063 >> 172.21.15.167:0/1608175063 conn(0x7f18240b3b50 msgr2=0x7f18240b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- 172.21.15.167:0/1608175063 shutdown_connections 2024-09-13T17:24:54.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.198+0000 7f1829658640 1 -- 172.21.15.167:0/1608175063 wait complete. 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 Processor -- start 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 -- start start 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18240b3530 0x7f1824140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824143fe0 0x7f182406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f182406e560 0x7f182406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182413cfe0 con 0x7f182406e560 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182406ef50 con 0x7f18240b3530 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1824141120 con 0x7f1824143fe0 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f182406e560 0x7f182406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f182406e560 0x7f182406ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44058/0 (socket says 172.21.15.167:44058) 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 -- 172.21.15.167:0/2293683568 learned_addr learned my addr 172.21.15.167:0/2293683568 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18227fc640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824143fe0 0x7f182406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1822ffd640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18240b3530 0x7f1824140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 -- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824143fe0 msgr2=0x7f182406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824143fe0 0x7f182406fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 -- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18240b3530 msgr2=0x7f1824140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18240b3530 0x7f1824140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 -- 172.21.15.167:0/2293683568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c009b30 con 0x7f182406e560 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f18237fe640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f182406e560 0x7f182406ea10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f181c01adb0 tx=0x7f181c0194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f180b7fe640 1 -- 172.21.15.167:0/2293683568 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0b8670 con 0x7f182406e560 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f180b7fe640 1 -- 172.21.15.167:0/2293683568 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c0b87d0 con 0x7f182406e560 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1824070340 con 0x7f182406e560 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f180b7fe640 1 -- 172.21.15.167:0/2293683568 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0b8b60 con 0x7f182406e560 2024-09-13T17:24:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1824071580 con 0x7f182406e560 2024-09-13T17:24:54.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182409cd00 con 0x7f182406e560 2024-09-13T17:24:54.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.202+0000 7f180b7fe640 1 -- 172.21.15.167:0/2293683568 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f181c0b8cc0 con 0x7f182406e560 2024-09-13T17:24:54.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.206+0000 7f180b7fe640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1810066690 0x7f1810068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.206+0000 7f180b7fe640 1 -- 172.21.15.167:0/2293683568 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f181c11f9b0 con 0x7f182406e560 2024-09-13T17:24:54.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.206+0000 7f1822ffd640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1810066690 0x7f1810068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.206+0000 7f1822ffd640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1810066690 0x7f1810068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f181400a8f0 tx=0x7f1814008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.210+0000 7f180b7fe640 1 -- 172.21.15.167:0/2293683568 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f181c0ecaf0 con 0x7f182406e560 2024-09-13T17:24:54.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1824142d20 con 0x7f182406e560 2024-09-13T17:24:54.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f180b7fe640 1 -- 172.21.15.167:0/2293683568 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f181c0bc0a0 con 0x7f182406e560 2024-09-13T17:24:54.361 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2024-09-13T17:24:54.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1810066690 msgr2=0x7f1810068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1810066690 0x7f1810068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f181400a8f0 tx=0x7f1814008040 comp rx=0 tx=0).stop 2024-09-13T17:24:54.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f182406e560 msgr2=0x7f182406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f182406e560 0x7f182406ea10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f181c01adb0 tx=0x7f181c0194a0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 shutdown_connections 2024-09-13T17:24:54.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1810066690 0x7f1810068b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f182406e560 0x7f182406ea10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1824143fe0 0x7f182406fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 --2- 172.21.15.167:0/2293683568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18240b3530 0x7f1824140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 >> 172.21.15.167:0/2293683568 conn(0x7f18240b3b50 msgr2=0x7f18241423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 shutdown_connections 2024-09-13T17:24:54.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.358+0000 7f1829658640 1 -- 172.21.15.167:0/2293683568 wait complete. 2024-09-13T17:24:54.380 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:54.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8198278640 1 Processor -- start 2024-09-13T17:24:54.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8198278640 1 -- start start 2024-09-13T17:24:54.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8198278640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81900b4210 0x7f8190140980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8198278640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f81900b45f0 0x7f8190140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8198278640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8190072300 con 0x7f8190143db0 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8198278640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8190144320 con 0x7f81900b4210 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8198278640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8190144600 con 0x7f81900b45f0 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8196014640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81900b4210 0x7f8190140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8196014640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81900b4210 0x7f8190140980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44072/0 (socket says 172.21.15.167:44072) 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.498+0000 7f8196014640 1 -- 172.21.15.167:0/2497026830 learned_addr learned my addr 172.21.15.167:0/2497026830 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8196014640 1 -- 172.21.15.167:0/2497026830 >> v2:172.21.15.190:3300/0 conn(0x7f81900b45f0 msgr2=0x7f8190140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8195813640 1 --2- 172.21.15.167:0/2497026830 >> v2:172.21.15.190:3300/0 conn(0x7f81900b45f0 0x7f8190140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8196014640 1 --2- 172.21.15.167:0/2497026830 >> v2:172.21.15.190:3300/0 conn(0x7f81900b45f0 0x7f8190140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8196014640 1 -- 172.21.15.167:0/2497026830 >> v1:172.21.15.190:6789/0 conn(0x7f8190143db0 legacy=0x7f8190070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:54.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8196014640 1 -- 172.21.15.167:0/2497026830 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819006e890 con 0x7f81900b4210 2024-09-13T17:24:54.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8196014640 1 --2- 172.21.15.167:0/2497026830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81900b4210 0x7f8190140980 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f819009b120 tx=0x7f818c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212d62d950b4430e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8195012640 1 -- 172.21.15.167:0/2497026830 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0ab600 con 0x7f81900b4210 2024-09-13T17:24:54.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8195012640 1 -- 172.21.15.167:0/2497026830 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c0a7050 con 0x7f81900b4210 2024-09-13T17:24:54.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8195012640 1 -- 172.21.15.167:0/2497026830 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0ab980 con 0x7f81900b4210 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 -- 172.21.15.167:0/2497026830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81900b4210 msgr2=0x7f8190140980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 --2- 172.21.15.167:0/2497026830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81900b4210 0x7f8190140980 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f819009b120 tx=0x7f818c01c450 comp rx=0 tx=0).stop 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 -- 172.21.15.167:0/2497026830 shutdown_connections 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 --2- 172.21.15.167:0/2497026830 >> v2:172.21.15.190:3300/0 conn(0x7f81900b45f0 0x7f8190140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 --2- 172.21.15.167:0/2497026830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81900b4210 0x7f8190140980 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 -- 172.21.15.167:0/2497026830 >> 172.21.15.167:0/2497026830 conn(0x7f819009b150 msgr2=0x7f819009b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 -- 172.21.15.167:0/2497026830 shutdown_connections 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.502+0000 7f8198278640 1 -- 172.21.15.167:0/2497026830 wait complete. 2024-09-13T17:24:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 Processor -- start 2024-09-13T17:24:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 -- start start 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81900b4210 0x7f819013b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81900b45f0 0x7f819013bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190143db0 0x7f81901de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819013c6a0 con 0x7f8190143db0 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190147580 con 0x7f81900b4210 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8190147860 con 0x7f81900b45f0 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190143db0 0x7f81901de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190143db0 0x7f81901de0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44088/0 (socket says 172.21.15.167:44088) 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 -- 172.21.15.167:0/2410668949 learned_addr learned my addr 172.21.15.167:0/2410668949 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196014640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81900b4210 0x7f819013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8195813640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81900b45f0 0x7f819013bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 -- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81900b45f0 msgr2=0x7f819013bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81900b45f0 0x7f819013bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 -- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81900b4210 msgr2=0x7f819013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81900b4210 0x7f819013b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 -- 172.21.15.167:0/2410668949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0094d0 con 0x7f8190143db0 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196815640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190143db0 0x7f81901de0e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f818800b990 tx=0x7f818800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8186ffd640 1 -- 172.21.15.167:0/2410668949 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818800cba0 con 0x7f8190143db0 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8186ffd640 1 -- 172.21.15.167:0/2410668949 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818800cd00 con 0x7f8190143db0 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81901de620 con 0x7f8190143db0 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8186ffd640 1 -- 172.21.15.167:0/2410668949 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188014680 con 0x7f8190143db0 2024-09-13T17:24:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819009a3a0 con 0x7f8190143db0 2024-09-13T17:24:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8190099ef0 con 0x7f8190143db0 2024-09-13T17:24:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8186ffd640 1 -- 172.21.15.167:0/2410668949 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81880147e0 con 0x7f8190143db0 2024-09-13T17:24:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8186ffd640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8174066690 0x7f8174068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8196014640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8174066690 0x7f8174068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.506+0000 7f8186ffd640 1 -- 172.21.15.167:0/2410668949 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8188084430 con 0x7f8190143db0 2024-09-13T17:24:54.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.510+0000 7f8196014640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8174066690 0x7f8174068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f818c0ad000 tx=0x7f818c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.514+0000 7f8186ffd640 1 -- 172.21.15.167:0/2410668949 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8190099ef0 con 0x7f8190143db0 2024-09-13T17:24:54.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.670+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8190099ef0 con 0x7f8190143db0 2024-09-13T17:24:54.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.670+0000 7f8186ffd640 1 -- 172.21.15.167:0/2410668949 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8190099ef0 con 0x7f8190143db0 2024-09-13T17:24:54.674 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:24:54.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8174066690 msgr2=0x7f8174068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8174066690 0x7f8174068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f818c0ad000 tx=0x7f818c008040 comp rx=0 tx=0).stop 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190143db0 msgr2=0x7f81901de0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190143db0 0x7f81901de0e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f818800b990 tx=0x7f818800be50 comp rx=0 tx=0).stop 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 shutdown_connections 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8174066690 0x7f8174068b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190143db0 0x7f81901de0e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81900b45f0 0x7f819013bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 --2- 172.21.15.167:0/2410668949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81900b4210 0x7f819013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 >> 172.21.15.167:0/2410668949 conn(0x7f819009b150 msgr2=0x7f819013e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 shutdown_connections 2024-09-13T17:24:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.674+0000 7f8198278640 1 -- 172.21.15.167:0/2410668949 wait complete. 2024-09-13T17:24:54.694 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:54.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5085c37640 1 Processor -- start 2024-09-13T17:24:54.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5085c37640 1 -- start start 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5085c37640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f508009ac70 0x7f50800ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5085c37640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50800b3c50 0x7f508006cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5085c37640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508009d850 con 0x7f508006a1e0 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5085c37640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50800b3260 con 0x7f50800b3c50 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5085c37640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50800b40c0 con 0x7f508009ac70 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f508006a1e0 0x7f508006c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52092/0 (socket says 172.21.15.167:52092) 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507f7fe640 1 -- 172.21.15.167:0/1100257298 learned_addr learned my addr 172.21.15.167:0/1100257298 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507ffff640 1 --2- 172.21.15.167:0/1100257298 >> v2:172.21.15.167:3300/0 conn(0x7f50800b3c50 0x7f508006cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f5077fff640 1 --2- 172.21.15.167:0/1100257298 >> v2:172.21.15.190:3300/0 conn(0x7f508009ac70 0x7f50800ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507effd640 1 -- 172.21.15.167:0/1100257298 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197916195 0 0) 0x7f508009d850 con 0x7f508006a1e0 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507effd640 1 -- 172.21.15.167:0/1100257298 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f506c003530 con 0x7f508006a1e0 2024-09-13T17:24:54.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507ffff640 1 -- 172.21.15.167:0/1100257298 >> v2:172.21.15.190:3300/0 conn(0x7f508009ac70 msgr2=0x7f50800ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:54.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507ffff640 1 --2- 172.21.15.167:0/1100257298 >> v2:172.21.15.190:3300/0 conn(0x7f508009ac70 0x7f50800ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507ffff640 1 -- 172.21.15.167:0/1100257298 >> v1:172.21.15.167:6789/0 conn(0x7f508006a1e0 legacy=0x7f508006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507ffff640 1 -- 172.21.15.167:0/1100257298 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508006a5c0 con 0x7f50800b3c50 2024-09-13T17:24:54.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.814+0000 7f507ffff640 1 --2- 172.21.15.167:0/1100257298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50800b3c50 0x7f508006cbf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f50800b5e70 tx=0x7f507801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b940f265c8dc4a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507effd640 1 -- 172.21.15.167:0/1100257298 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50780a58f0 con 0x7f50800b3c50 2024-09-13T17:24:54.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507effd640 1 -- 172.21.15.167:0/1100257298 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50780a5a50 con 0x7f50800b3c50 2024-09-13T17:24:54.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507effd640 1 -- 172.21.15.167:0/1100257298 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50780a5de0 con 0x7f50800b3c50 2024-09-13T17:24:54.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- 172.21.15.167:0/1100257298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50800b3c50 msgr2=0x7f508006cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 --2- 172.21.15.167:0/1100257298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50800b3c50 0x7f508006cbf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f50800b5e70 tx=0x7f507801c810 comp rx=0 tx=0).stop 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- 172.21.15.167:0/1100257298 shutdown_connections 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 --2- 172.21.15.167:0/1100257298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50800b3c50 0x7f508006cbf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 --2- 172.21.15.167:0/1100257298 >> v2:172.21.15.190:3300/0 conn(0x7f508009ac70 0x7f50800ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- 172.21.15.167:0/1100257298 >> 172.21.15.167:0/1100257298 conn(0x7f508006bbc0 msgr2=0x7f50800b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- 172.21.15.167:0/1100257298 shutdown_connections 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- 172.21.15.167:0/1100257298 wait complete. 2024-09-13T17:24:54.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 Processor -- start 2024-09-13T17:24:54.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- start start 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f508006a1e0 0x7f50801e1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508009ac70 0x7f5080146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50800b3c50 0x7f50801473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50800afe30 con 0x7f508006a1e0 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50800b0360 con 0x7f508009ac70 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5080146b10 con 0x7f50800b3c50 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f508006a1e0 0x7f50801e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f508006a1e0 0x7f50801e1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44112/0 (socket says 172.21.15.167:44112) 2024-09-13T17:24:54.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 -- 172.21.15.167:0/852811644 learned_addr learned my addr 172.21.15.167:0/852811644 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5077fff640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508009ac70 0x7f5080146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507ffff640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50800b3c50 0x7f50801473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 -- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50800b3c50 msgr2=0x7f50801473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50800b3c50 0x7f50801473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 -- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508009ac70 msgr2=0x7f5080146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508009ac70 0x7f5080146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 -- 172.21.15.167:0/852811644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078009a70 con 0x7f508006a1e0 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507ffff640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50800b3c50 0x7f50801473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507f7fe640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f508006a1e0 0x7f50801e1140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f507000c4d0 tx=0x7f507000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507cff9640 1 -- 172.21.15.167:0/852811644 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070005cf0 con 0x7f508006a1e0 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507cff9640 1 -- 172.21.15.167:0/852811644 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070005e50 con 0x7f508006a1e0 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50801e1a20 con 0x7f508006a1e0 2024-09-13T17:24:54.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f507cff9640 1 -- 172.21.15.167:0/852811644 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070007270 con 0x7f508006a1e0 2024-09-13T17:24:54.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.818+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50801e1680 con 0x7f508006a1e0 2024-09-13T17:24:54.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.822+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50801e1c60 con 0x7f508006a1e0 2024-09-13T17:24:54.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.822+0000 7f507cff9640 1 -- 172.21.15.167:0/852811644 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50700073d0 con 0x7f508006a1e0 2024-09-13T17:24:54.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.822+0000 7f507cff9640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5060066690 0x7f5060068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:54.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.822+0000 7f507cff9640 1 -- 172.21.15.167:0/852811644 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5070083a50 con 0x7f508006a1e0 2024-09-13T17:24:54.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.822+0000 7f5077fff640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5060066690 0x7f5060068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:54.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.822+0000 7f5077fff640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5060066690 0x7f5060068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f508013daf0 tx=0x7f5068008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:54.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.826+0000 7f507cff9640 1 -- 172.21.15.167:0/852811644 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50801e1c60 con 0x7f508006a1e0 2024-09-13T17:24:54.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50801e1c60 con 0x7f508006a1e0 2024-09-13T17:24:54.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f507cff9640 1 -- 172.21.15.167:0/852811644 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50700170a0 con 0x7f508006a1e0 2024-09-13T17:24:54.977 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2024-09-13T17:24:54.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5060066690 msgr2=0x7f5060068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5060066690 0x7f5060068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f508013daf0 tx=0x7f5068008040 comp rx=0 tx=0).stop 2024-09-13T17:24:54.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f508006a1e0 msgr2=0x7f50801e1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f508006a1e0 0x7f50801e1140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f507000c4d0 tx=0x7f507000c990 comp rx=0 tx=0).stop 2024-09-13T17:24:54.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 shutdown_connections 2024-09-13T17:24:54.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5060066690 0x7f5060068b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50800b3c50 0x7f50801473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f508009ac70 0x7f5080146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 --2- 172.21.15.167:0/852811644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f508006a1e0 0x7f50801e1140 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 >> 172.21.15.167:0/852811644 conn(0x7f508006bbc0 msgr2=0x7f508006f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 shutdown_connections 2024-09-13T17:24:54.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:54.974+0000 7f5085c37640 1 -- 172.21.15.167:0/852811644 wait complete. 2024-09-13T17:24:54.995 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:55.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.110+0000 7f0622edf640 1 Processor -- start 2024-09-13T17:24:55.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.110+0000 7f0622edf640 1 -- start start 2024-09-13T17:24:55.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.110+0000 7f0622edf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0b3510 0x7f061c156270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.110+0000 7f0622edf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f061c0adf90 0x7f061c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.110+0000 7f0622edf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c06bcd0 con 0x7f061c1567b0 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.110+0000 7f0622edf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0acc40 con 0x7f061c0adf90 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.110+0000 7f0622edf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0ace40 con 0x7f061c0b3510 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.114+0000 7f062147c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f061c0adf90 0x7f061c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.114+0000 7f062147c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f061c0adf90 0x7f061c15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44128/0 (socket says 172.21.15.167:44128) 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.114+0000 7f062147c640 1 -- 172.21.15.167:0/2967762330 learned_addr learned my addr 172.21.15.167:0/2967762330 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.114+0000 7f0620c7b640 1 --2- 172.21.15.167:0/2967762330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0b3510 0x7f061c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.114+0000 7f061b7fe640 1 -- 172.21.15.167:0/2967762330 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564037635 0 0) 0x7f061c06bcd0 con 0x7f061c1567b0 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.178+0000 7f061b7fe640 1 -- 172.21.15.167:0/2967762330 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0604003530 con 0x7f061c1567b0 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.178+0000 7f062147c640 1 -- 172.21.15.167:0/2967762330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0b3510 msgr2=0x7f061c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:55.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.178+0000 7f062147c640 1 --2- 172.21.15.167:0/2967762330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0b3510 0x7f061c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.178+0000 7f062147c640 1 -- 172.21.15.167:0/2967762330 >> v1:172.21.15.190:6789/0 conn(0x7f061c1567b0 legacy=0x7f061c0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.178+0000 7f062147c640 1 -- 172.21.15.167:0/2967762330 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c156bf0 con 0x7f061c0adf90 2024-09-13T17:24:55.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.182+0000 7f062147c640 1 --2- 172.21.15.167:0/2967762330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0adf90 0x7f061c15d000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f061400c2e0 tx=0x7f061401dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff55e0f0c10ea7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:55.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.182+0000 7f061b7fe640 1 -- 172.21.15.167:0/2967762330 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a6df0 con 0x7f061c0adf90 2024-09-13T17:24:55.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.182+0000 7f061b7fe640 1 -- 172.21.15.167:0/2967762330 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400a0d0 con 0x7f061c0adf90 2024-09-13T17:24:55.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.182+0000 7f061b7fe640 1 -- 172.21.15.167:0/2967762330 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400a460 con 0x7f061c0adf90 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 -- 172.21.15.167:0/2967762330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0adf90 msgr2=0x7f061c15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 --2- 172.21.15.167:0/2967762330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0adf90 0x7f061c15d000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f061400c2e0 tx=0x7f061401dd30 comp rx=0 tx=0).stop 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 -- 172.21.15.167:0/2967762330 shutdown_connections 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 --2- 172.21.15.167:0/2967762330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0adf90 0x7f061c15d000 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 --2- 172.21.15.167:0/2967762330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0b3510 0x7f061c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 -- 172.21.15.167:0/2967762330 >> 172.21.15.167:0/2967762330 conn(0x7f061c0b7450 msgr2=0x7f061c0b7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 -- 172.21.15.167:0/2967762330 shutdown_connections 2024-09-13T17:24:55.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 -- 172.21.15.167:0/2967762330 wait complete. 2024-09-13T17:24:55.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 Processor -- start 2024-09-13T17:24:55.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.186+0000 7f0622edf640 1 -- start start 2024-09-13T17:24:55.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0adf90 0x7f061c070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0b3510 0x7f061c1f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f061c1567b0 0x7f061c1f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c15a050 con 0x7f061c0b3510 2024-09-13T17:24:55.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c159d70 con 0x7f061c1567b0 2024-09-13T17:24:55.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c15c870 con 0x7f061c0adf90 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0b3510 0x7f061c1f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0b3510 0x7f061c1f00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44132/0 (socket says 172.21.15.167:44132) 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 -- 172.21.15.167:0/480720005 learned_addr learned my addr 172.21.15.167:0/480720005 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0620c7b640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0adf90 0x7f061c070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f062147c640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f061c1567b0 0x7f061c1f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 -- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0adf90 msgr2=0x7f061c070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0adf90 0x7f061c070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 -- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f061c1567b0 msgr2=0x7f061c1f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f061c1567b0 0x7f061c1f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 -- 172.21.15.167:0/480720005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061400c050 con 0x7f061c0b3510 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f062147c640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f061c1567b0 0x7f061c1f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f061bfff640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0b3510 0x7f061c1f00c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f060c00c430 tx=0x7f060c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:55.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f06197fa640 1 -- 172.21.15.167:0/480720005 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c0052d0 con 0x7f061c0b3510 2024-09-13T17:24:55.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f06197fa640 1 -- 172.21.15.167:0/480720005 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c005450 con 0x7f061c0b3510 2024-09-13T17:24:55.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f06197fa640 1 -- 172.21.15.167:0/480720005 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c003840 con 0x7f061c0b3510 2024-09-13T17:24:55.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c159a00 con 0x7f061c0b3510 2024-09-13T17:24:55.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c0891e0 con 0x7f061c0b3510 2024-09-13T17:24:55.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c156270 con 0x7f061c0b3510 2024-09-13T17:24:55.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f06197fa640 1 -- 172.21.15.167:0/480720005 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f060c0039a0 con 0x7f061c0b3510 2024-09-13T17:24:55.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f06197fa640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0608066690 0x7f0608068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f06197fa640 1 -- 172.21.15.167:0/480720005 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f060c083b90 con 0x7f061c0b3510 2024-09-13T17:24:55.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.190+0000 7f0620c7b640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0608066690 0x7f0608068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.194+0000 7f0620c7b640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0608066690 0x7f0608068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0610009d10 tx=0x7f0610009360 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:55.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.198+0000 7f06197fa640 1 -- 172.21.15.167:0/480720005 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f060c050b10 con 0x7f061c0b3510 2024-09-13T17:24:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f061c071fa0 con 0x7f061c0b3510 2024-09-13T17:24:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f06197fa640 1 -- 172.21.15.167:0/480720005 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f060c0170a0 con 0x7f061c0b3510 2024-09-13T17:24:55.345 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0608066690 msgr2=0x7f0608068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0608066690 0x7f0608068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0610009d10 tx=0x7f0610009360 comp rx=0 tx=0).stop 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0b3510 msgr2=0x7f061c1f00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0b3510 0x7f061c1f00c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f060c00c430 tx=0x7f060c00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 shutdown_connections 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0608066690 0x7f0608068b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f061c1567b0 0x7f061c1f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f061c0b3510 0x7f061c1f00c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 --2- 172.21.15.167:0/480720005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f061c0adf90 0x7f061c070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 >> 172.21.15.167:0/480720005 conn(0x7f061c0b7450 msgr2=0x7f061c154910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 shutdown_connections 2024-09-13T17:24:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.342+0000 7f0622edf640 1 -- 172.21.15.167:0/480720005 wait complete. 2024-09-13T17:24:55.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:24:55.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff883167640 1 Processor -- start 2024-09-13T17:24:55.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff883167640 1 -- start start 2024-09-13T17:24:55.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff883167640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff87c071d00 0x7ff87c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff883167640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c09cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff883167640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c0ae000 con 0x7ff87c0aca80 2024-09-13T17:24:55.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff883167640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87c0b2c00 con 0x7ff87c071d00 2024-09-13T17:24:55.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff883167640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c145cb0 con 0x7ff87c09cb40 2024-09-13T17:24:55.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff87bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff87c071d00 0x7ff87c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff87bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff87c071d00 0x7ff87c0ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44144/0 (socket says 172.21.15.167:44144) 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff87bfff640 1 -- 172.21.15.167:0/1186111778 learned_addr learned my addr 172.21.15.167:0/1186111778 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff881704640 1 --2- 172.21.15.167:0/1186111778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c09cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff87bfff640 1 -- 172.21.15.167:0/1186111778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 msgr2=0x7ff87c09cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff87bfff640 1 --2- 172.21.15.167:0/1186111778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c09cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff87bfff640 1 -- 172.21.15.167:0/1186111778 >> v1:172.21.15.167:6789/0 conn(0x7ff87c0aca80 legacy=0x7ff87c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff87bfff640 1 -- 172.21.15.167:0/1186111778 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c099c60 con 0x7ff87c071d00 2024-09-13T17:24:55.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.474+0000 7ff881704640 1 --2- 172.21.15.167:0/1186111778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c09cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:55.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 --2- 172.21.15.167:0/1186111778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c071d00 0x7ff87c0ace60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff870009870 tx=0x7ff87001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9455bcc940661272 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:55.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87b7fe640 1 -- 172.21.15.167:0/1186111778 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8700ac640 con 0x7ff87c071d00 2024-09-13T17:24:55.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87b7fe640 1 -- 172.21.15.167:0/1186111778 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8700ac7a0 con 0x7ff87c071d00 2024-09-13T17:24:55.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87b7fe640 1 -- 172.21.15.167:0/1186111778 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8700acb30 con 0x7ff87c071d00 2024-09-13T17:24:55.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- 172.21.15.167:0/1186111778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c071d00 msgr2=0x7ff87c0ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 --2- 172.21.15.167:0/1186111778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c071d00 0x7ff87c0ace60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff870009870 tx=0x7ff87001c4d0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- 172.21.15.167:0/1186111778 shutdown_connections 2024-09-13T17:24:55.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 --2- 172.21.15.167:0/1186111778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c09cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 --2- 172.21.15.167:0/1186111778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c071d00 0x7ff87c0ace60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- 172.21.15.167:0/1186111778 >> 172.21.15.167:0/1186111778 conn(0x7ff87c0b3b50 msgr2=0x7ff87c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:55.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- 172.21.15.167:0/1186111778 shutdown_connections 2024-09-13T17:24:55.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- 172.21.15.167:0/1186111778 wait complete. 2024-09-13T17:24:55.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 Processor -- start 2024-09-13T17:24:55.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- start start 2024-09-13T17:24:55.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c0aca80 0x7ff87c1e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff87c140d20 0x7ff87c139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c13bb40 con 0x7ff87c0aca80 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c1405b0 con 0x7ff87c140d20 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff883167640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c140890 con 0x7ff87c09cb40 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c0aca80 0x7ff87c1e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c0aca80 0x7ff87c1e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44148/0 (socket says 172.21.15.167:44148) 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 -- 172.21.15.167:0/1329207571 learned_addr learned my addr 172.21.15.167:0/1329207571 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff880f03640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 -- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 msgr2=0x7ff87c0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c0b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 -- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff87c140d20 msgr2=0x7ff87c139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff881704640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff87c140d20 0x7ff87c139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff87c140d20 0x7ff87c139290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff87bfff640 1 -- 172.21.15.167:0/1329207571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700094d0 con 0x7ff87c0aca80 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.478+0000 7ff880f03640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff87bfff640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c0aca80 0x7ff87c1e1310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff8700af040 tx=0x7ff870019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff8797fa640 1 -- 172.21.15.167:0/1329207571 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8700ac640 con 0x7ff87c0aca80 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff8797fa640 1 -- 172.21.15.167:0/1329207571 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8700b5870 con 0x7ff87c0aca80 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87c13bd50 con 0x7ff87c0aca80 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff8797fa640 1 -- 172.21.15.167:0/1329207571 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8700b5c20 con 0x7ff87c0aca80 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c1e1850 con 0x7ff87c0aca80 2024-09-13T17:24:55.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87c1409d0 con 0x7ff87c0aca80 2024-09-13T17:24:55.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff8797fa640 1 -- 172.21.15.167:0/1329207571 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff8700b3070 con 0x7ff87c0aca80 2024-09-13T17:24:55.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff8797fa640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff8680666c0 0x7ff868068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:55.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff8797fa640 1 -- 172.21.15.167:0/1329207571 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff87011e910 con 0x7ff87c0aca80 2024-09-13T17:24:55.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff880f03640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff8680666c0 0x7ff868068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:55.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.482+0000 7ff880f03640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff8680666c0 0x7ff868068b80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff86c000f70 tx=0x7ff86c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:55.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.486+0000 7ff8797fa640 1 -- 172.21.15.167:0/1329207571 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8700eb930 con 0x7ff87c0aca80 2024-09-13T17:24:55.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.642+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff87c0ada40 con 0x7ff87c0aca80 2024-09-13T17:24:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.642+0000 7ff8797fa640 1 -- 172.21.15.167:0/1329207571 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff8700eef50 con 0x7ff87c0aca80 2024-09-13T17:24:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:listed 0 entries 2024-09-13T17:24:55.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff8680666c0 msgr2=0x7ff868068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff8680666c0 0x7ff868068b80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff86c000f70 tx=0x7ff86c009040 comp rx=0 tx=0).stop 2024-09-13T17:24:55.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c0aca80 msgr2=0x7ff87c1e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:55.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c0aca80 0x7ff87c1e1310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff8700af040 tx=0x7ff870019270 comp rx=0 tx=0).stop 2024-09-13T17:24:55.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 shutdown_connections 2024-09-13T17:24:55.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7ff8680666c0 0x7ff868068b80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff87c140d20 0x7ff87c139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff87c0aca80 0x7ff87c1e1310 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 --2- 172.21.15.167:0/1329207571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff87c09cb40 0x7ff87c0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:55.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 >> 172.21.15.167:0/1329207571 conn(0x7ff87c0b3b50 msgr2=0x7ff87c14b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:55.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 shutdown_connections 2024-09-13T17:24:55.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:55.646+0000 7ff883167640 1 -- 172.21.15.167:0/1329207571 wait complete. 2024-09-13T17:24:55.663 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2024-09-13T17:24:55.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:55.664 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:24:55.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:ceph-fuse[36768]: fuse finished with error 0 and tester_r 0 2024-09-13T17:24:55.687 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:24:55.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:24:55.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:55.785 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:24:55.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:55.795 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-13T17:24:55.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:24:55.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:55.893 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:24:55.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:55.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-09-13T17:24:56.090 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T17:24:56.100 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:24:56.100 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:24:56.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.222+0000 7f3752bf0640 1 Processor -- start 2024-09-13T17:24:56.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.222+0000 7f3752bf0640 1 -- start start 2024-09-13T17:24:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f3752bf0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f374c0b1eb0 0x7f374c0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f3752bf0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f374c13f9d0 0x7f374c13fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f3752bf0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c0b00b0 con 0x7f374c145cb0 2024-09-13T17:24:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f3752bf0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c146100 con 0x7f374c13f9d0 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f3752bf0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c0b2290 con 0x7f374c0b1eb0 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f374bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f374c145cb0 0x7f374c0b1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52110/0 (socket says 172.21.15.167:52110) 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f375118d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f374c13f9d0 0x7f374c13fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f374bfff640 1 -- 172.21.15.167:0/210326306 learned_addr learned my addr 172.21.15.167:0/210326306 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f375098c640 1 --2- 172.21.15.167:0/210326306 >> v2:172.21.15.190:3300/0 conn(0x7f374c0b1eb0 0x7f374c0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f375118d640 1 -- 172.21.15.167:0/210326306 >> v2:172.21.15.190:3300/0 conn(0x7f374c0b1eb0 msgr2=0x7f374c0b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f375118d640 1 --2- 172.21.15.167:0/210326306 >> v2:172.21.15.190:3300/0 conn(0x7f374c0b1eb0 0x7f374c0b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f375118d640 1 -- 172.21.15.167:0/210326306 >> v1:172.21.15.167:6789/0 conn(0x7f374c145cb0 legacy=0x7f374c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f375118d640 1 -- 172.21.15.167:0/210326306 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c06f600 con 0x7f374c13f9d0 2024-09-13T17:24:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f375118d640 1 --2- 172.21.15.167:0/210326306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c13f9d0 0x7f374c13fde0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f374c067960 tx=0x7f374401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423c4f5d020cd26c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f374b7fe640 1 -- 172.21.15.167:0/210326306 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440a5850 con 0x7f374c13f9d0 2024-09-13T17:24:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f374b7fe640 1 -- 172.21.15.167:0/210326306 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37440a59b0 con 0x7f374c13f9d0 2024-09-13T17:24:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.226+0000 7f374b7fe640 1 -- 172.21.15.167:0/210326306 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440a5d40 con 0x7f374c13f9d0 2024-09-13T17:24:56.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- 172.21.15.167:0/210326306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c13f9d0 msgr2=0x7f374c13fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 --2- 172.21.15.167:0/210326306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c13f9d0 0x7f374c13fde0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f374c067960 tx=0x7f374401c8a0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- 172.21.15.167:0/210326306 shutdown_connections 2024-09-13T17:24:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 --2- 172.21.15.167:0/210326306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c13f9d0 0x7f374c13fde0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 --2- 172.21.15.167:0/210326306 >> v2:172.21.15.190:3300/0 conn(0x7f374c0b1eb0 0x7f374c0b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- 172.21.15.167:0/210326306 >> 172.21.15.167:0/210326306 conn(0x7f374c0b7250 msgr2=0x7f374c0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- 172.21.15.167:0/210326306 shutdown_connections 2024-09-13T17:24:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- 172.21.15.167:0/210326306 wait complete. 2024-09-13T17:24:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 Processor -- start 2024-09-13T17:24:56.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- start start 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f374c0b1eb0 0x7f374c145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f374c13f9d0 0x7f374c136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c145cb0 0x7f374c1df380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c144050 con 0x7f374c145cb0 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c1472d0 con 0x7f374c0b1eb0 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f3752bf0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c1dfec0 con 0x7f374c13f9d0 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c145cb0 0x7f374c1df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c145cb0 0x7f374c1df380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44168/0 (socket says 172.21.15.167:44168) 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 -- 172.21.15.167:0/1503261125 learned_addr learned my addr 172.21.15.167:0/1503261125 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375098c640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f374c0b1eb0 0x7f374c145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f374bfff640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f374c13f9d0 0x7f374c136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 -- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f374c13f9d0 msgr2=0x7f374c136fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f374c13f9d0 0x7f374c136fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 -- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f374c0b1eb0 msgr2=0x7f374c145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f374c0b1eb0 0x7f374c145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 -- 172.21.15.167:0/1503261125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744009a70 con 0x7f374c145cb0 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f375118d640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c145cb0 0x7f374c1df380 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f37440194b0 tx=0x7f3744019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f37497fa640 1 -- 172.21.15.167:0/1503261125 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440b9860 con 0x7f374c145cb0 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.230+0000 7f37497fa640 1 -- 172.21.15.167:0/1503261125 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37440b99c0 con 0x7f374c145cb0 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c148200 con 0x7f374c145cb0 2024-09-13T17:24:56.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f37497fa640 1 -- 172.21.15.167:0/1503261125 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440b9d70 con 0x7f374c145cb0 2024-09-13T17:24:56.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c147090 con 0x7f374c145cb0 2024-09-13T17:24:56.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c0ae5d0 con 0x7f374c145cb0 2024-09-13T17:24:56.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f37497fa640 1 -- 172.21.15.167:0/1503261125 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f37440ad440 con 0x7f374c145cb0 2024-09-13T17:24:56.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f37497fa640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f37380666c0 0x7f3738068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f375098c640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f37380666c0 0x7f3738068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f37497fa640 1 -- 172.21.15.167:0/1503261125 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f374411f750 con 0x7f374c145cb0 2024-09-13T17:24:56.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.234+0000 7f375098c640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f37380666c0 0x7f3738068b80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f373c00b930 tx=0x7f373c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.238+0000 7f37497fa640 1 -- 172.21.15.167:0/1503261125 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f37440ec770 con 0x7f374c145cb0 2024-09-13T17:24:56.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.394+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f374c147090 con 0x7f37380666c0 2024-09-13T17:24:56.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.422+0000 7f37497fa640 1 -- 172.21.15.167:0/1503261125 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368510 (secure 0 0 0) 0x7f374c147090 con 0x7f37380666c0 2024-09-13T17:24:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:24:56.433 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:24:56.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f37380666c0 msgr2=0x7f3738068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f37380666c0 0x7f3738068b80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f373c00b930 tx=0x7f373c008040 comp rx=0 tx=0).stop 2024-09-13T17:24:56.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c145cb0 msgr2=0x7f374c1df380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c145cb0 0x7f374c1df380 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f37440194b0 tx=0x7f3744019640 comp rx=0 tx=0).stop 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 shutdown_connections 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f37380666c0 0x7f3738068b80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c145cb0 0x7f374c1df380 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f374c13f9d0 0x7f374c136fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 --2- 172.21.15.167:0/1503261125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f374c0b1eb0 0x7f374c145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 >> 172.21.15.167:0/1503261125 conn(0x7f374c0b7250 msgr2=0x7f374c0b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 shutdown_connections 2024-09-13T17:24:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.430+0000 7f3752bf0640 1 -- 172.21.15.167:0/1503261125 wait complete. 2024-09-13T17:24:56.451 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T17:24:55.575970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1408757,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":304,"num_write_kb":3290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221348,"kb_used_data":5220,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753372,"statfs":{"total":773094113280,"available":772867452928,"internally_reserved":0,"allocated":5345280,"data_stored":3814953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23093,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003919"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712812+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:21:32.712812+0000","last_peered":"2024-09-13T17:21:32.712812+0000","last_clean":"2024-09-13T17:21:32.712812+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:21:32.712812+0000","last_undegraded":"2024-09-13T17:21:32.712812+0000","last_fullsized":"2024-09-13T17:21:32.712812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.549720+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:22:53.549720+0000","last_peered":"2024-09-13T17:22:53.549720+0000","last_clean":"2024-09-13T17:22:53.549720+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:22:53.549720+0000","last_undegraded":"2024-09-13T17:22:53.549720+0000","last_fullsized":"2024-09-13T17:22:53.549720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709835+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:21:32.709835+0000","last_peered":"2024-09-13T17:21:32.709835+0000","last_clean":"2024-09-13T17:21:32.709835+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:21:32.709835+0000","last_undegraded":"2024-09-13T17:21:32.709835+0000","last_fullsized":"2024-09-13T17:21:32.709835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.549774+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:22:53.549774+0000","last_peered":"2024-09-13T17:22:53.549774+0000","last_clean":"2024-09-13T17:22:53.549774+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:22:53.549774+0000","last_undegraded":"2024-09-13T17:22:53.549774+0000","last_fullsized":"2024-09-13T17:22:53.549774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712492+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:21:32.712492+0000","last_peered":"2024-09-13T17:21:32.712492+0000","last_clean":"2024-09-13T17:21:32.712492+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:21:32.712492+0000","last_undegraded":"2024-09-13T17:21:32.712492+0000","last_fullsized":"2024-09-13T17:21:32.712492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715058+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:21:32.715058+0000","last_peered":"2024-09-13T17:21:32.715058+0000","last_clean":"2024-09-13T17:21:32.715058+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:21:32.715058+0000","last_undegraded":"2024-09-13T17:21:32.715058+0000","last_fullsized":"2024-09-13T17:21:32.715058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.030817+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:22:41.030817+0000","last_peered":"2024-09-13T17:22:41.030817+0000","last_clean":"2024-09-13T17:22:41.030817+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:22:41.030817+0000","last_undegraded":"2024-09-13T17:22:41.030817+0000","last_fullsized":"2024-09-13T17:22:41.030817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.720891+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:21:32.720891+0000","last_peered":"2024-09-13T17:21:32.720891+0000","last_clean":"2024-09-13T17:21:32.720891+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:21:32.720891+0000","last_undegraded":"2024-09-13T17:21:32.720891+0000","last_fullsized":"2024-09-13T17:21:32.720891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715545+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:21:32.715545+0000","last_peered":"2024-09-13T17:21:32.715545+0000","last_clean":"2024-09-13T17:21:32.715545+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:21:32.715545+0000","last_undegraded":"2024-09-13T17:21:32.715545+0000","last_fullsized":"2024-09-13T17:21:32.715545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.557212+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:23:23.557212+0000","last_peered":"2024-09-13T17:23:23.557212+0000","last_clean":"2024-09-13T17:23:23.557212+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:23:23.557212+0000","last_undegraded":"2024-09-13T17:23:23.557212+0000","last_fullsized":"2024-09-13T17:23:23.557212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721716+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:21:32.721716+0000","last_peered":"2024-09-13T17:21:32.721716+0000","last_clean":"2024-09-13T17:21:32.721716+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:21:32.721716+0000","last_undegraded":"2024-09-13T17:21:32.721716+0000","last_fullsized":"2024-09-13T17:21:32.721716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715495+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:21:32.715495+0000","last_peered":"2024-09-13T17:21:32.715495+0000","last_clean":"2024-09-13T17:21:32.715495+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:21:32.715495+0000","last_undegraded":"2024-09-13T17:21:32.715495+0000","last_fullsized":"2024-09-13T17:21:32.715495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373334+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:21:33.373334+0000","last_peered":"2024-09-13T17:21:33.373334+0000","last_clean":"2024-09-13T17:21:33.373334+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:21:33.373334+0000","last_undegraded":"2024-09-13T17:21:33.373334+0000","last_fullsized":"2024-09-13T17:21:33.373334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.044555+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:22:51.044555+0000","last_peered":"2024-09-13T17:22:51.044555+0000","last_clean":"2024-09-13T17:22:51.044555+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:22:51.044555+0000","last_undegraded":"2024-09-13T17:22:51.044555+0000","last_fullsized":"2024-09-13T17:22:51.044555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.716876+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:21:32.716876+0000","last_peered":"2024-09-13T17:21:32.716876+0000","last_clean":"2024-09-13T17:21:32.716876+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:21:32.716876+0000","last_undegraded":"2024-09-13T17:21:32.716876+0000","last_fullsized":"2024-09-13T17:21:32.716876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713629+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:21:32.713629+0000","last_peered":"2024-09-13T17:21:32.713629+0000","last_clean":"2024-09-13T17:21:32.713629+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:21:32.713629+0000","last_undegraded":"2024-09-13T17:21:32.713629+0000","last_fullsized":"2024-09-13T17:21:32.713629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780740+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:21:32.780740+0000","last_peered":"2024-09-13T17:21:32.780740+0000","last_clean":"2024-09-13T17:21:32.780740+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:21:32.780740+0000","last_undegraded":"2024-09-13T17:21:32.780740+0000","last_fullsized":"2024-09-13T17:21:32.780740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717428+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:21:32.717428+0000","last_peered":"2024-09-13T17:21:32.717428+0000","last_clean":"2024-09-13T17:21:32.717428+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:21:32.717428+0000","last_undegraded":"2024-09-13T17:21:32.717428+0000","last_fullsized":"2024-09-13T17:21:32.717428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710241+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:21:32.710241+0000","last_peered":"2024-09-13T17:21:32.710241+0000","last_clean":"2024-09-13T17:21:32.710241+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:21:32.710241+0000","last_undegraded":"2024-09-13T17:21:32.710241+0000","last_fullsized":"2024-09-13T17:21:32.710241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.041977+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:22:51.041977+0000","last_peered":"2024-09-13T17:22:51.041977+0000","last_clean":"2024-09-13T17:22:51.041977+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:22:51.041977+0000","last_undegraded":"2024-09-13T17:22:51.041977+0000","last_fullsized":"2024-09-13T17:22:51.041977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781403+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:21:32.781403+0000","last_peered":"2024-09-13T17:21:32.781403+0000","last_clean":"2024-09-13T17:21:32.781403+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:21:32.781403+0000","last_undegraded":"2024-09-13T17:21:32.781403+0000","last_fullsized":"2024-09-13T17:21:32.781403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715766+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:21:32.715766+0000","last_peered":"2024-09-13T17:21:32.715766+0000","last_clean":"2024-09-13T17:21:32.715766+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:21:32.715766+0000","last_undegraded":"2024-09-13T17:21:32.715766+0000","last_fullsized":"2024-09-13T17:21:32.715766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043779+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:22:51.043779+0000","last_peered":"2024-09-13T17:22:51.043779+0000","last_clean":"2024-09-13T17:22:51.043779+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:22:51.043779+0000","last_undegraded":"2024-09-13T17:22:51.043779+0000","last_fullsized":"2024-09-13T17:22:51.043779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.377950+0000","last_change":"2024-09-13T17:21:33.376826+0000","last_active":"2024-09-13T17:21:33.377950+0000","last_peered":"2024-09-13T17:21:33.377950+0000","last_clean":"2024-09-13T17:21:33.377950+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:21:33.377950+0000","last_undegraded":"2024-09-13T17:21:33.377950+0000","last_fullsized":"2024-09-13T17:21:33.377950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:39.885449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712490+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:21:32.712490+0000","last_peered":"2024-09-13T17:21:32.712490+0000","last_clean":"2024-09-13T17:21:32.712490+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:21:32.712490+0000","last_undegraded":"2024-09-13T17:21:32.712490+0000","last_fullsized":"2024-09-13T17:21:32.712490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047002+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:22:51.047002+0000","last_peered":"2024-09-13T17:22:51.047002+0000","last_clean":"2024-09-13T17:22:51.047002+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:22:51.047002+0000","last_undegraded":"2024-09-13T17:22:51.047002+0000","last_fullsized":"2024-09-13T17:22:51.047002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715303+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:21:32.715303+0000","last_peered":"2024-09-13T17:21:32.715303+0000","last_clean":"2024-09-13T17:21:32.715303+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:21:32.715303+0000","last_undegraded":"2024-09-13T17:21:32.715303+0000","last_fullsized":"2024-09-13T17:21:32.715303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715332+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:21:32.715332+0000","last_peered":"2024-09-13T17:21:32.715332+0000","last_clean":"2024-09-13T17:21:32.715332+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:21:32.715332+0000","last_undegraded":"2024-09-13T17:21:32.715332+0000","last_fullsized":"2024-09-13T17:21:32.715332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'21","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:59.882120+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:23:59.882120+0000","last_peered":"2024-09-13T17:23:59.882120+0000","last_clean":"2024-09-13T17:23:59.882120+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:23:59.882120+0000","last_undegraded":"2024-09-13T17:23:59.882120+0000","last_fullsized":"2024-09-13T17:23:59.882120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709522+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:21:32.709522+0000","last_peered":"2024-09-13T17:21:32.709522+0000","last_clean":"2024-09-13T17:21:32.709522+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:21:32.709522+0000","last_undegraded":"2024-09-13T17:21:32.709522+0000","last_fullsized":"2024-09-13T17:21:32.709522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.543105+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:22:58.543105+0000","last_peered":"2024-09-13T17:22:58.543105+0000","last_clean":"2024-09-13T17:22:58.543105+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:22:58.543105+0000","last_undegraded":"2024-09-13T17:22:58.543105+0000","last_fullsized":"2024-09-13T17:22:58.543105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.031459+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:22:41.031459+0000","last_peered":"2024-09-13T17:22:41.031459+0000","last_clean":"2024-09-13T17:22:41.031459+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:22:41.031459+0000","last_undegraded":"2024-09-13T17:22:41.031459+0000","last_fullsized":"2024-09-13T17:22:41.031459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:50.928673+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:23:50.928673+0000","last_peered":"2024-09-13T17:23:50.928673+0000","last_clean":"2024-09-13T17:23:50.928673+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:23:50.928673+0000","last_undegraded":"2024-09-13T17:23:50.928673+0000","last_fullsized":"2024-09-13T17:23:50.928673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.785217+0000","last_change":"2024-09-13T17:21:32.783988+0000","last_active":"2024-09-13T17:21:32.785217+0000","last_peered":"2024-09-13T17:21:32.785217+0000","last_clean":"2024-09-13T17:21:32.785217+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:21:32.785217+0000","last_undegraded":"2024-09-13T17:21:32.785217+0000","last_fullsized":"2024-09-13T17:21:32.785217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:39.042962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780985+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:21:32.780985+0000","last_peered":"2024-09-13T17:21:32.780985+0000","last_clean":"2024-09-13T17:21:32.780985+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:21:32.780985+0000","last_undegraded":"2024-09-13T17:21:32.780985+0000","last_fullsized":"2024-09-13T17:21:32.780985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780248+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:21:32.780248+0000","last_peered":"2024-09-13T17:21:32.780248+0000","last_clean":"2024-09-13T17:21:32.780248+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:21:32.780248+0000","last_undegraded":"2024-09-13T17:21:32.780248+0000","last_fullsized":"2024-09-13T17:21:32.780248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.550986+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:22:58.550986+0000","last_peered":"2024-09-13T17:22:58.550986+0000","last_clean":"2024-09-13T17:22:58.550986+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:22:58.550986+0000","last_undegraded":"2024-09-13T17:22:58.550986+0000","last_fullsized":"2024-09-13T17:22:58.550986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.034077+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:22:46.034077+0000","last_peered":"2024-09-13T17:22:46.034077+0000","last_clean":"2024-09-13T17:22:46.034077+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:22:46.034077+0000","last_undegraded":"2024-09-13T17:22:46.034077+0000","last_fullsized":"2024-09-13T17:22:46.034077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:50.314123+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:24:50.314123+0000","last_peered":"2024-09-13T17:24:50.314123+0000","last_clean":"2024-09-13T17:24:50.314123+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:24:50.314123+0000","last_undegraded":"2024-09-13T17:24:50.314123+0000","last_fullsized":"2024-09-13T17:24:50.314123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.541951+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:22:53.541951+0000","last_peered":"2024-09-13T17:22:53.541951+0000","last_clean":"2024-09-13T17:22:53.541951+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:22:53.541951+0000","last_undegraded":"2024-09-13T17:22:53.541951+0000","last_fullsized":"2024-09-13T17:22:53.541951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'18","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:56.078682+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:23:56.078682+0000","last_peered":"2024-09-13T17:23:56.078682+0000","last_clean":"2024-09-13T17:23:56.078682+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:23:56.078682+0000","last_undegraded":"2024-09-13T17:23:56.078682+0000","last_fullsized":"2024-09-13T17:23:56.078682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:09.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10613,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":19,"num_write":12,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781623+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:21:32.781623+0000","last_peered":"2024-09-13T17:21:32.781623+0000","last_clean":"2024-09-13T17:21:32.781623+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:21:32.781623+0000","last_undegraded":"2024-09-13T17:21:32.781623+0000","last_fullsized":"2024-09-13T17:21:32.781623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711531+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:21:32.711531+0000","last_peered":"2024-09-13T17:21:32.711531+0000","last_clean":"2024-09-13T17:21:32.711531+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:21:32.711531+0000","last_undegraded":"2024-09-13T17:21:32.711531+0000","last_fullsized":"2024-09-13T17:21:32.711531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.550732+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:22:53.550732+0000","last_peered":"2024-09-13T17:22:53.550732+0000","last_clean":"2024-09-13T17:22:53.550732+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:22:53.550732+0000","last_undegraded":"2024-09-13T17:22:53.550732+0000","last_fullsized":"2024-09-13T17:22:53.550732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.206492+0000","last_change":"2024-09-13T17:21:33.205535+0000","last_active":"2024-09-13T17:21:33.206492+0000","last_peered":"2024-09-13T17:21:33.206492+0000","last_clean":"2024-09-13T17:21:33.206492+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:21:33.206492+0000","last_undegraded":"2024-09-13T17:21:33.206492+0000","last_fullsized":"2024-09-13T17:21:33.206492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:01.951295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.790078+0000","last_change":"2024-09-13T17:21:32.786124+0000","last_active":"2024-09-13T17:21:32.790078+0000","last_peered":"2024-09-13T17:21:32.790078+0000","last_clean":"2024-09-13T17:21:32.790078+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:21:32.790078+0000","last_undegraded":"2024-09-13T17:21:32.790078+0000","last_fullsized":"2024-09-13T17:21:32.790078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:04.040678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043912+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:22:51.043912+0000","last_peered":"2024-09-13T17:22:51.043912+0000","last_clean":"2024-09-13T17:22:51.043912+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:22:51.043912+0000","last_undegraded":"2024-09-13T17:22:51.043912+0000","last_fullsized":"2024-09-13T17:22:51.043912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:43.548854+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:22:43.548854+0000","last_peered":"2024-09-13T17:22:43.548854+0000","last_clean":"2024-09-13T17:22:43.548854+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:22:43.548854+0000","last_undegraded":"2024-09-13T17:22:43.548854+0000","last_fullsized":"2024-09-13T17:22:43.548854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373613+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:21:33.373613+0000","last_peered":"2024-09-13T17:21:33.373613+0000","last_clean":"2024-09-13T17:21:33.373613+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:21:33.373613+0000","last_undegraded":"2024-09-13T17:21:33.373613+0000","last_fullsized":"2024-09-13T17:21:33.373613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201783+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:21:33.201783+0000","last_peered":"2024-09-13T17:21:33.201783+0000","last_clean":"2024-09-13T17:21:33.201783+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:21:33.201783+0000","last_undegraded":"2024-09-13T17:21:33.201783+0000","last_fullsized":"2024-09-13T17:21:33.201783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043713+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:22:51.043713+0000","last_peered":"2024-09-13T17:22:51.043713+0000","last_clean":"2024-09-13T17:22:51.043713+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:22:51.043713+0000","last_undegraded":"2024-09-13T17:22:51.043713+0000","last_fullsized":"2024-09-13T17:22:51.043713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373267+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:21:33.373267+0000","last_peered":"2024-09-13T17:21:33.373267+0000","last_clean":"2024-09-13T17:21:33.373267+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:21:33.373267+0000","last_undegraded":"2024-09-13T17:21:33.373267+0000","last_fullsized":"2024-09-13T17:21:33.373267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721076+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:21:32.721076+0000","last_peered":"2024-09-13T17:21:32.721076+0000","last_clean":"2024-09-13T17:21:32.721076+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:21:32.721076+0000","last_undegraded":"2024-09-13T17:21:32.721076+0000","last_fullsized":"2024-09-13T17:21:32.721076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.042941+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:22:51.042941+0000","last_peered":"2024-09-13T17:22:51.042941+0000","last_clean":"2024-09-13T17:22:51.042941+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:22:51.042941+0000","last_undegraded":"2024-09-13T17:22:51.042941+0000","last_fullsized":"2024-09-13T17:22:51.042941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712372+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:21:32.712372+0000","last_peered":"2024-09-13T17:21:32.712372+0000","last_clean":"2024-09-13T17:21:32.712372+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:21:32.712372+0000","last_undegraded":"2024-09-13T17:21:32.712372+0000","last_fullsized":"2024-09-13T17:21:32.712372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.202208+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:21:33.202208+0000","last_peered":"2024-09-13T17:21:33.202208+0000","last_clean":"2024-09-13T17:21:33.202208+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:21:33.202208+0000","last_undegraded":"2024-09-13T17:21:33.202208+0000","last_fullsized":"2024-09-13T17:21:33.202208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.045308+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:22:51.045308+0000","last_peered":"2024-09-13T17:22:51.045308+0000","last_clean":"2024-09-13T17:22:51.045308+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:22:51.045308+0000","last_undegraded":"2024-09-13T17:22:51.045308+0000","last_fullsized":"2024-09-13T17:22:51.045308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:33.533450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717513+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:21:32.717513+0000","last_peered":"2024-09-13T17:21:32.717513+0000","last_clean":"2024-09-13T17:21:32.717513+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:21:32.717513+0000","last_undegraded":"2024-09-13T17:21:32.717513+0000","last_fullsized":"2024-09-13T17:21:32.717513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519587+0000","last_change":"2024-09-13T17:21:32.725077+0000","last_active":"2024-09-13T17:21:36.519587+0000","last_peered":"2024-09-13T17:21:36.519587+0000","last_clean":"2024-09-13T17:21:36.519587+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:21:36.519587+0000","last_undegraded":"2024-09-13T17:21:36.519587+0000","last_fullsized":"2024-09-13T17:21:36.519587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:17.569869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043971+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:22:51.043971+0000","last_peered":"2024-09-13T17:22:51.043971+0000","last_clean":"2024-09-13T17:22:51.043971+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:22:51.043971+0000","last_undegraded":"2024-09-13T17:22:51.043971+0000","last_fullsized":"2024-09-13T17:22:51.043971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715050+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:21:32.715050+0000","last_peered":"2024-09-13T17:21:32.715050+0000","last_clean":"2024-09-13T17:21:32.715050+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:21:32.715050+0000","last_undegraded":"2024-09-13T17:21:32.715050+0000","last_fullsized":"2024-09-13T17:21:32.715050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201878+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:21:33.201878+0000","last_peered":"2024-09-13T17:21:33.201878+0000","last_clean":"2024-09-13T17:21:33.201878+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:21:33.201878+0000","last_undegraded":"2024-09-13T17:21:33.201878+0000","last_fullsized":"2024-09-13T17:21:33.201878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.042768+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:22:51.042768+0000","last_peered":"2024-09-13T17:22:51.042768+0000","last_clean":"2024-09-13T17:22:51.042768+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:22:51.042768+0000","last_undegraded":"2024-09-13T17:22:51.042768+0000","last_fullsized":"2024-09-13T17:22:51.042768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:25.139372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711905+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:21:32.711905+0000","last_peered":"2024-09-13T17:21:32.711905+0000","last_clean":"2024-09-13T17:21:32.711905+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:21:32.711905+0000","last_undegraded":"2024-09-13T17:21:32.711905+0000","last_fullsized":"2024-09-13T17:21:32.711905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373494+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:21:33.373494+0000","last_peered":"2024-09-13T17:21:33.373494+0000","last_clean":"2024-09-13T17:21:33.373494+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:21:33.373494+0000","last_undegraded":"2024-09-13T17:21:33.373494+0000","last_fullsized":"2024-09-13T17:21:33.373494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047765+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:22:51.047765+0000","last_peered":"2024-09-13T17:22:51.047765+0000","last_clean":"2024-09-13T17:22:51.047765+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:22:51.047765+0000","last_undegraded":"2024-09-13T17:22:51.047765+0000","last_fullsized":"2024-09-13T17:22:51.047765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715067+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:21:32.715067+0000","last_peered":"2024-09-13T17:21:32.715067+0000","last_clean":"2024-09-13T17:21:32.715067+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:21:32.715067+0000","last_undegraded":"2024-09-13T17:21:32.715067+0000","last_fullsized":"2024-09-13T17:21:32.715067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201601+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:21:33.201601+0000","last_peered":"2024-09-13T17:21:33.201601+0000","last_clean":"2024-09-13T17:21:33.201601+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:21:33.201601+0000","last_undegraded":"2024-09-13T17:21:33.201601+0000","last_fullsized":"2024-09-13T17:21:33.201601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046511+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:22:51.046511+0000","last_peered":"2024-09-13T17:22:51.046511+0000","last_clean":"2024-09-13T17:22:51.046511+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:22:51.046511+0000","last_undegraded":"2024-09-13T17:22:51.046511+0000","last_fullsized":"2024-09-13T17:22:51.046511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713774+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:21:32.713774+0000","last_peered":"2024-09-13T17:21:32.713774+0000","last_clean":"2024-09-13T17:21:32.713774+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:21:32.713774+0000","last_undegraded":"2024-09-13T17:21:32.713774+0000","last_fullsized":"2024-09-13T17:21:32.713774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712593+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:21:32.712593+0000","last_peered":"2024-09-13T17:21:32.712593+0000","last_clean":"2024-09-13T17:21:32.712593+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:21:32.712593+0000","last_undegraded":"2024-09-13T17:21:32.712593+0000","last_fullsized":"2024-09-13T17:21:32.712593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.028553+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:22:41.028553+0000","last_peered":"2024-09-13T17:22:41.028553+0000","last_clean":"2024-09-13T17:22:41.028553+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:22:41.028553+0000","last_undegraded":"2024-09-13T17:22:41.028553+0000","last_fullsized":"2024-09-13T17:22:41.028553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721562+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:21:32.721562+0000","last_peered":"2024-09-13T17:21:32.721562+0000","last_clean":"2024-09-13T17:21:32.721562+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:21:32.721562+0000","last_undegraded":"2024-09-13T17:21:32.721562+0000","last_fullsized":"2024-09-13T17:21:32.721562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201631+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:21:33.201631+0000","last_peered":"2024-09-13T17:21:33.201631+0000","last_clean":"2024-09-13T17:21:33.201631+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:21:33.201631+0000","last_undegraded":"2024-09-13T17:21:33.201631+0000","last_fullsized":"2024-09-13T17:21:33.201631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'57","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:50.418915+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:24:50.418915+0000","last_peered":"2024-09-13T17:24:50.418915+0000","last_clean":"2024-09-13T17:24:50.418915+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:24:50.418915+0000","last_undegraded":"2024-09-13T17:24:50.418915+0000","last_fullsized":"2024-09-13T17:24:50.418915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":806978,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780411+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:21:32.780411+0000","last_peered":"2024-09-13T17:21:32.780411+0000","last_clean":"2024-09-13T17:21:32.780411+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:21:32.780411+0000","last_undegraded":"2024-09-13T17:21:32.780411+0000","last_fullsized":"2024-09-13T17:21:32.780411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717981+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:21:32.717981+0000","last_peered":"2024-09-13T17:21:32.717981+0000","last_clean":"2024-09-13T17:21:32.717981+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:21:32.717981+0000","last_undegraded":"2024-09-13T17:21:32.717981+0000","last_fullsized":"2024-09-13T17:21:32.717981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'14","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:52.126340+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:24:52.126340+0000","last_peered":"2024-09-13T17:24:52.126340+0000","last_clean":"2024-09-13T17:24:52.126340+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:24:52.126340+0000","last_undegraded":"2024-09-13T17:24:52.126340+0000","last_fullsized":"2024-09-13T17:24:52.126340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715770+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:21:32.715770+0000","last_peered":"2024-09-13T17:21:32.715770+0000","last_clean":"2024-09-13T17:21:32.715770+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:21:32.715770+0000","last_undegraded":"2024-09-13T17:21:32.715770+0000","last_fullsized":"2024-09-13T17:21:32.715770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519675+0000","last_change":"2024-09-13T17:21:32.722613+0000","last_active":"2024-09-13T17:21:36.519675+0000","last_peered":"2024-09-13T17:21:36.519675+0000","last_clean":"2024-09-13T17:21:36.519675+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:21:36.519675+0000","last_undegraded":"2024-09-13T17:21:36.519675+0000","last_fullsized":"2024-09-13T17:21:36.519675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:48.677916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047585+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:22:51.047585+0000","last_peered":"2024-09-13T17:22:51.047585+0000","last_clean":"2024-09-13T17:22:51.047585+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:22:51.047585+0000","last_undegraded":"2024-09-13T17:22:51.047585+0000","last_fullsized":"2024-09-13T17:22:51.047585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709825+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:21:32.709825+0000","last_peered":"2024-09-13T17:21:32.709825+0000","last_clean":"2024-09-13T17:21:32.709825+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:21:32.709825+0000","last_undegraded":"2024-09-13T17:21:32.709825+0000","last_fullsized":"2024-09-13T17:21:32.709825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721834+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:21:32.721834+0000","last_peered":"2024-09-13T17:21:32.721834+0000","last_clean":"2024-09-13T17:21:32.721834+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:21:32.721834+0000","last_undegraded":"2024-09-13T17:21:32.721834+0000","last_fullsized":"2024-09-13T17:21:32.721834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046749+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:22:51.046749+0000","last_peered":"2024-09-13T17:22:51.046749+0000","last_clean":"2024-09-13T17:22:51.046749+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:22:51.046749+0000","last_undegraded":"2024-09-13T17:22:51.046749+0000","last_fullsized":"2024-09-13T17:22:51.046749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710043+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:21:32.710043+0000","last_peered":"2024-09-13T17:21:32.710043+0000","last_clean":"2024-09-13T17:21:32.710043+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:21:32.710043+0000","last_undegraded":"2024-09-13T17:21:32.710043+0000","last_fullsized":"2024-09-13T17:21:32.710043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711841+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:21:32.711841+0000","last_peered":"2024-09-13T17:21:32.711841+0000","last_clean":"2024-09-13T17:21:32.711841+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:21:32.711841+0000","last_undegraded":"2024-09-13T17:21:32.711841+0000","last_fullsized":"2024-09-13T17:21:32.711841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.779844+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:21:32.779844+0000","last_peered":"2024-09-13T17:21:32.779844+0000","last_clean":"2024-09-13T17:21:32.779844+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:21:32.779844+0000","last_undegraded":"2024-09-13T17:21:32.779844+0000","last_fullsized":"2024-09-13T17:21:32.779844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046252+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:22:51.046252+0000","last_peered":"2024-09-13T17:22:51.046252+0000","last_clean":"2024-09-13T17:22:51.046252+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:22:51.046252+0000","last_undegraded":"2024-09-13T17:22:51.046252+0000","last_fullsized":"2024-09-13T17:22:51.046252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374293+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:21:33.374293+0000","last_peered":"2024-09-13T17:21:33.374293+0000","last_clean":"2024-09-13T17:21:33.374293+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:21:33.374293+0000","last_undegraded":"2024-09-13T17:21:33.374293+0000","last_fullsized":"2024-09-13T17:21:33.374293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710039+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:21:32.710039+0000","last_peered":"2024-09-13T17:21:32.710039+0000","last_clean":"2024-09-13T17:21:32.710039+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:21:32.710039+0000","last_undegraded":"2024-09-13T17:21:32.710039+0000","last_fullsized":"2024-09-13T17:21:32.710039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046569+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:22:51.046569+0000","last_peered":"2024-09-13T17:22:51.046569+0000","last_clean":"2024-09-13T17:22:51.046569+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:22:51.046569+0000","last_undegraded":"2024-09-13T17:22:51.046569+0000","last_fullsized":"2024-09-13T17:22:51.046569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.032396+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:22:46.032396+0000","last_peered":"2024-09-13T17:22:46.032396+0000","last_clean":"2024-09-13T17:22:46.032396+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:22:46.032396+0000","last_undegraded":"2024-09-13T17:22:46.032396+0000","last_fullsized":"2024-09-13T17:22:46.032396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712613+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:21:32.712613+0000","last_peered":"2024-09-13T17:21:32.712613+0000","last_clean":"2024-09-13T17:21:32.712613+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:21:32.712613+0000","last_undegraded":"2024-09-13T17:21:32.712613+0000","last_fullsized":"2024-09-13T17:21:32.712613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717613+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:21:32.717613+0000","last_peered":"2024-09-13T17:21:32.717613+0000","last_clean":"2024-09-13T17:21:32.717613+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:21:32.717613+0000","last_undegraded":"2024-09-13T17:21:32.717613+0000","last_fullsized":"2024-09-13T17:21:32.717613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:31.608726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.027160+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:22:41.027160+0000","last_peered":"2024-09-13T17:22:41.027160+0000","last_clean":"2024-09-13T17:22:41.027160+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:22:41.027160+0000","last_undegraded":"2024-09-13T17:22:41.027160+0000","last_fullsized":"2024-09-13T17:22:41.027160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715927+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:21:32.715927+0000","last_peered":"2024-09-13T17:21:32.715927+0000","last_clean":"2024-09-13T17:21:32.715927+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:21:32.715927+0000","last_undegraded":"2024-09-13T17:21:32.715927+0000","last_fullsized":"2024-09-13T17:21:32.715927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.726286+0000","last_change":"2024-09-13T17:21:32.724190+0000","last_active":"2024-09-13T17:21:32.726286+0000","last_peered":"2024-09-13T17:21:32.726286+0000","last_clean":"2024-09-13T17:21:32.726286+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:21:32.726286+0000","last_undegraded":"2024-09-13T17:21:32.726286+0000","last_fullsized":"2024-09-13T17:21:32.726286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:48.005131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373229+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:21:33.373229+0000","last_peered":"2024-09-13T17:21:33.373229+0000","last_clean":"2024-09-13T17:21:33.373229+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:21:33.373229+0000","last_undegraded":"2024-09-13T17:21:33.373229+0000","last_fullsized":"2024-09-13T17:21:33.373229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717837+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:21:32.717837+0000","last_peered":"2024-09-13T17:21:32.717837+0000","last_clean":"2024-09-13T17:21:32.717837+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:21:32.717837+0000","last_undegraded":"2024-09-13T17:21:32.717837+0000","last_fullsized":"2024-09-13T17:21:32.717837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:44.697368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.719820+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:21:32.719820+0000","last_peered":"2024-09-13T17:21:32.719820+0000","last_clean":"2024-09-13T17:21:32.719820+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:21:32.719820+0000","last_undegraded":"2024-09-13T17:21:32.719820+0000","last_fullsized":"2024-09-13T17:21:32.719820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712462+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:21:32.712462+0000","last_peered":"2024-09-13T17:21:32.712462+0000","last_clean":"2024-09-13T17:21:32.712462+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:21:32.712462+0000","last_undegraded":"2024-09-13T17:21:32.712462+0000","last_fullsized":"2024-09-13T17:21:32.712462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.714328+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:21:32.714328+0000","last_peered":"2024-09-13T17:21:32.714328+0000","last_clean":"2024-09-13T17:21:32.714328+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:21:32.714328+0000","last_undegraded":"2024-09-13T17:21:32.714328+0000","last_fullsized":"2024-09-13T17:21:32.714328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780794+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:21:32.780794+0000","last_peered":"2024-09-13T17:21:32.780794+0000","last_clean":"2024-09-13T17:21:32.780794+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:21:32.780794+0000","last_undegraded":"2024-09-13T17:21:32.780794+0000","last_fullsized":"2024-09-13T17:21:32.780794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374611+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:21:33.374611+0000","last_peered":"2024-09-13T17:21:33.374611+0000","last_clean":"2024-09-13T17:21:33.374611+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:21:33.374611+0000","last_undegraded":"2024-09-13T17:21:33.374611+0000","last_fullsized":"2024-09-13T17:21:33.374611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715221+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:21:32.715221+0000","last_peered":"2024-09-13T17:21:32.715221+0000","last_clean":"2024-09-13T17:21:32.715221+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:21:32.715221+0000","last_undegraded":"2024-09-13T17:21:32.715221+0000","last_fullsized":"2024-09-13T17:21:32.715221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.718384+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:21:32.718384+0000","last_peered":"2024-09-13T17:21:32.718384+0000","last_clean":"2024-09-13T17:21:32.718384+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:21:32.718384+0000","last_undegraded":"2024-09-13T17:21:32.718384+0000","last_fullsized":"2024-09-13T17:21:32.718384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710471+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:21:32.710471+0000","last_peered":"2024-09-13T17:21:32.710471+0000","last_clean":"2024-09-13T17:21:32.710471+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:21:32.710471+0000","last_undegraded":"2024-09-13T17:21:32.710471+0000","last_fullsized":"2024-09-13T17:21:32.710471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.719661+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:21:32.719661+0000","last_peered":"2024-09-13T17:21:32.719661+0000","last_clean":"2024-09-13T17:21:32.719661+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:21:32.719661+0000","last_undegraded":"2024-09-13T17:21:32.719661+0000","last_fullsized":"2024-09-13T17:21:32.719661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712107+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:21:32.712107+0000","last_peered":"2024-09-13T17:21:32.712107+0000","last_clean":"2024-09-13T17:21:32.712107+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:21:32.712107+0000","last_undegraded":"2024-09-13T17:21:32.712107+0000","last_fullsized":"2024-09-13T17:21:32.712107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374030+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:21:33.374030+0000","last_peered":"2024-09-13T17:21:33.374030+0000","last_clean":"2024-09-13T17:21:33.374030+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:21:33.374030+0000","last_undegraded":"2024-09-13T17:21:33.374030+0000","last_fullsized":"2024-09-13T17:21:33.374030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.202223+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:21:33.202223+0000","last_peered":"2024-09-13T17:21:33.202223+0000","last_clean":"2024-09-13T17:21:33.202223+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:21:33.202223+0000","last_undegraded":"2024-09-13T17:21:33.202223+0000","last_fullsized":"2024-09-13T17:21:33.202223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.720422+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:21:32.720422+0000","last_peered":"2024-09-13T17:21:32.720422+0000","last_clean":"2024-09-13T17:21:32.720422+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:21:32.720422+0000","last_undegraded":"2024-09-13T17:21:32.720422+0000","last_fullsized":"2024-09-13T17:21:32.720422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:03.506249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.722233+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:21:32.722233+0000","last_peered":"2024-09-13T17:21:32.722233+0000","last_clean":"2024-09-13T17:21:32.722233+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:21:32.722233+0000","last_undegraded":"2024-09-13T17:21:32.722233+0000","last_fullsized":"2024-09-13T17:21:32.722233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.718784+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:21:32.718784+0000","last_peered":"2024-09-13T17:21:32.718784+0000","last_clean":"2024-09-13T17:21:32.718784+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:21:32.718784+0000","last_undegraded":"2024-09-13T17:21:32.718784+0000","last_fullsized":"2024-09-13T17:21:32.718784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.779951+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:21:32.779951+0000","last_peered":"2024-09-13T17:21:32.779951+0000","last_clean":"2024-09-13T17:21:32.779951+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:21:32.779951+0000","last_undegraded":"2024-09-13T17:21:32.779951+0000","last_fullsized":"2024-09-13T17:21:32.779951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712325+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:21:32.712325+0000","last_peered":"2024-09-13T17:21:32.712325+0000","last_clean":"2024-09-13T17:21:32.712325+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:21:32.712325+0000","last_undegraded":"2024-09-13T17:21:32.712325+0000","last_fullsized":"2024-09-13T17:21:32.712325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713394+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:21:32.713394+0000","last_peered":"2024-09-13T17:21:32.713394+0000","last_clean":"2024-09-13T17:21:32.713394+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:21:32.713394+0000","last_undegraded":"2024-09-13T17:21:32.713394+0000","last_fullsized":"2024-09-13T17:21:32.713394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717783+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:21:32.717783+0000","last_peered":"2024-09-13T17:21:32.717783+0000","last_clean":"2024-09-13T17:21:32.717783+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:21:32.717783+0000","last_undegraded":"2024-09-13T17:21:32.717783+0000","last_fullsized":"2024-09-13T17:21:32.717783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374235+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:21:33.374235+0000","last_peered":"2024-09-13T17:21:33.374235+0000","last_clean":"2024-09-13T17:21:33.374235+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:21:33.374235+0000","last_undegraded":"2024-09-13T17:21:33.374235+0000","last_fullsized":"2024-09-13T17:21:33.374235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374509+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:21:33.374509+0000","last_peered":"2024-09-13T17:21:33.374509+0000","last_clean":"2024-09-13T17:21:33.374509+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:21:33.374509+0000","last_undegraded":"2024-09-13T17:21:33.374509+0000","last_fullsized":"2024-09-13T17:21:33.374509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201762+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:21:33.201762+0000","last_peered":"2024-09-13T17:21:33.201762+0000","last_clean":"2024-09-13T17:21:33.201762+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:21:33.201762+0000","last_undegraded":"2024-09-13T17:21:33.201762+0000","last_fullsized":"2024-09-13T17:21:33.201762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709799+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:21:32.709799+0000","last_peered":"2024-09-13T17:21:32.709799+0000","last_clean":"2024-09-13T17:21:32.709799+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:21:32.709799+0000","last_undegraded":"2024-09-13T17:21:32.709799+0000","last_fullsized":"2024-09-13T17:21:32.709799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201226+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:21:33.201226+0000","last_peered":"2024-09-13T17:21:33.201226+0000","last_clean":"2024-09-13T17:21:33.201226+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:21:33.201226+0000","last_undegraded":"2024-09-13T17:21:33.201226+0000","last_fullsized":"2024-09-13T17:21:33.201226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519499+0000","last_change":"2024-09-13T17:21:32.721986+0000","last_active":"2024-09-13T17:21:36.519499+0000","last_peered":"2024-09-13T17:21:36.519499+0000","last_clean":"2024-09-13T17:21:36.519499+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:21:36.519499+0000","last_undegraded":"2024-09-13T17:21:36.519499+0000","last_fullsized":"2024-09-13T17:21:36.519499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:04.661478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201356+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:21:33.201356+0000","last_peered":"2024-09-13T17:21:33.201356+0000","last_clean":"2024-09-13T17:21:33.201356+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:21:33.201356+0000","last_undegraded":"2024-09-13T17:21:33.201356+0000","last_fullsized":"2024-09-13T17:21:33.201356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.556068+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:22:53.556068+0000","last_peered":"2024-09-13T17:22:53.556068+0000","last_clean":"2024-09-13T17:22:53.556068+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:22:53.556068+0000","last_undegraded":"2024-09-13T17:22:53.556068+0000","last_fullsized":"2024-09-13T17:22:53.556068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712194+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:21:32.712194+0000","last_peered":"2024-09-13T17:21:32.712194+0000","last_clean":"2024-09-13T17:21:32.712194+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:21:32.712194+0000","last_undegraded":"2024-09-13T17:21:32.712194+0000","last_fullsized":"2024-09-13T17:21:32.712194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781454+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:21:32.781454+0000","last_peered":"2024-09-13T17:21:32.781454+0000","last_clean":"2024-09-13T17:21:32.781454+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:21:32.781454+0000","last_undegraded":"2024-09-13T17:21:32.781454+0000","last_fullsized":"2024-09-13T17:21:32.781454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201533+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:21:33.201533+0000","last_peered":"2024-09-13T17:21:33.201533+0000","last_clean":"2024-09-13T17:21:33.201533+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:21:33.201533+0000","last_undegraded":"2024-09-13T17:21:33.201533+0000","last_fullsized":"2024-09-13T17:21:33.201533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":818389,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":19,"num_write":139,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1695744,"data_stored":1637089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.86799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.081,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2150000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.92800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0660000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.04},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1379999999999999,"5min":1.216,"15min":1.216},"last":1.218}]},{"osd":2,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.29},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.84099999999999997},"min":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.526,"15min":1.526},"last":1.0589999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.91000000000000003,"15min":0.93799999999999994},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.165,"5min":1.23,"15min":1.23},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96699999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.109,"5min":1.365,"15min":1.365},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.109},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.167,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1859999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0720000000000001,"15min":1.1200000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.218,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.139},{"interface":"front","average":{"1min":1.046,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.88900000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2549999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.085}]}]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1122304,"data_stored":931107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.501,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1140000000000001,"5min":1.167,"15min":1.167},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.84199999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1379999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0720000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0880000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.997}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.875,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.181,"5min":1.615,"15min":1.615},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.268,"15min":1.268},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":2.149,"15min":2.149},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98999999999999999,"15min":1.018},"min":{"1min":0.70099999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1200000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.153}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.218,"5min":1.367,"15min":1.367},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0429999999999999,"15min":1.0669999999999999},"min":{"1min":0.68500000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.21,"5min":2.069,"15min":2.069},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.077},"min":{"1min":0.76300000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2150000000000001,"5min":1.964,"15min":1.964},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.997,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.73299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.619,"15min":1.619},"last":1.034}]}]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.232,"15min":1.232},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.84999999999999998},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.84599999999999997,"15min":0.86399999999999999},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.71999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.466,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97299999999999998,"15min":0.997},"min":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.276,"5min":1.339,"15min":1.339},"last":0.745}]},{"osd":4,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.97399999999999998,"15min":0.94999999999999996},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.075,"15min":1.1040000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":1.339,"15min":1.339},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.84299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.129,"15min":1.159},"min":{"1min":0.872,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0640000000000001,"15min":1.0940000000000001},"min":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83299999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.111,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.872},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.873,"15min":0.92700000000000005},"min":{"1min":0.505,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0049999999999999,"5min":1.611,"15min":1.611},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78800000000000003,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.879},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.1120000000000001,"5min":1.23,"15min":1.23},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90200000000000002,"15min":0.96899999999999997},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1020000000000001,"5min":1.754,"15min":1.754},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1990000000000001,"5min":1.268,"15min":1.268},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.92300000000000004,"15min":0.98299999999999998},"min":{"1min":0.68000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.78,"15min":1.78},"last":1.0089999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0960000000000001,"5min":1.694,"15min":1.694},"last":1.161},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.032,"15min":1.0840000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1399999999999999,"5min":1.907,"15min":1.907},"last":0.98599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.97899999999999998,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1299999999999999,"5min":1.53,"15min":1.53},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0509999999999999,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1539999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.0960000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.1220000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.137,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.089,"15min":1.147},"min":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1970000000000001,"5min":1.863,"15min":1.863},"last":1.0609999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1134592,"data_stored":942031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.78000000000000003,"5min":1.014,"15min":1.014},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.054,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.38}]},{"osd":1,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.66200000000000003},"min":{"1min":0.32000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.34599999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.93999999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.70499999999999996},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1060000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.71499999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.022,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.02,"5min":1.51,"15min":1.51},"last":1.024},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3300000000000001,"5min":1.421,"15min":1.421},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.61499999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1020000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96799999999999997,"15min":1.01},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.397,"5min":1.712,"15min":1.712},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3280000000000001,"5min":1.756,"15min":1.756},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94799999999999995,"15min":1.004},"min":{"1min":0.59499999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.248,"5min":1.946,"15min":1.946},"last":0.93899999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.61599999999999999},"min":{"1min":0.26000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.62,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.85199999999999998,"5min":1.466,"15min":1.466},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59399999999999997,"15min":0.622},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95199999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.29699999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.94099999999999995,"5min":1.419,"15min":1.419},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.72199999999999998},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91600000000000004,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.625,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.878,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1020000000000001,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91300000000000003,"15min":0.96699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2529999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":0.97999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2669999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3580000000000001,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95299999999999996,"15min":1.026},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3049999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":1.02},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.65000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3400000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.88700000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57599999999999996,"15min":0.626},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63800000000000001,"15min":0.66700000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.873,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89400000000000002,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":1.214,"5min":1.401,"15min":1.401},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.877},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.752},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.88700000000000001},"min":{"1min":0.57499999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.266,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88800000000000001,"15min":0.93899999999999995},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2709999999999999,"5min":1.365,"15min":1.365},"last":0.80800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86499999999999999,"15min":0.91700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1870000000000001,"5min":1.323,"15min":1.323},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.995},"min":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.23,"5min":1.639,"15min":1.639},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92600000000000005,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.528,"15min":1.528},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":138838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.58899999999999997},"min":{"1min":0.28399999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.60499999999999998},"min":{"1min":0.308,"5min":0.255,"15min":0.255},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83499999999999996,"5min":1.075,"15min":1.075},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.66200000000000003},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.749}]},{"osd":3,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60799999999999998,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.88400000000000001,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.72999999999999998},"min":{"1min":0.36199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.88200000000000001},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.153,"5min":1.351,"15min":1.351},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0109999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.878,"15min":0.93799999999999994},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.056,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1799999999999999,"5min":1.21,"15min":1.21},"last":0.82599999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.92200000000000004},"min":{"1min":0.56799999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1359999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.425,"15min":1.425},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.127,"5min":1.554,"15min":1.554},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92100000000000004,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1040000000000001,"5min":1.454,"15min":1.454},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":817902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":815104,"data_stored":806978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:24:56.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.606+0000 7f8759560640 1 Processor -- start 2024-09-13T17:24:56.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8759560640 1 -- start start 2024-09-13T17:24:56.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8759560640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 0x7f87540b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8759560640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8754145cb0 0x7f87540b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8759560640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87540b00b0 con 0x7f875413f9d0 2024-09-13T17:24:56.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8759560640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87540b2290 con 0x7f8754145cb0 2024-09-13T17:24:56.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8759560640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87540b1580 con 0x7f87540b1eb0 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f875413f9d0 0x7f87540ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52120/0 (socket says 172.21.15.167:52120) 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 -- 172.21.15.167:0/1957214949 learned_addr learned my addr 172.21.15.167:0/1957214949 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8752ffd640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 0x7f87540b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f874a7fc640 1 --2- 172.21.15.167:0/1957214949 >> v2:172.21.15.190:3300/0 conn(0x7f8754145cb0 0x7f87540b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182289859 0 0) 0x7f87540b00b0 con 0x7f875413f9d0 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8740003530 con 0x7f875413f9d0 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861168326 0 0) 0x7f8740003530 con 0x7f875413f9d0 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 msgr2=0x7f87540b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 0x7f87540b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 >> v2:172.21.15.190:3300/0 conn(0x7f8754145cb0 msgr2=0x7f87540b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 --2- 172.21.15.167:0/1957214949 >> v2:172.21.15.190:3300/0 conn(0x7f8754145cb0 0x7f87540b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875406f600 con 0x7f875413f9d0 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f874c001a00 con 0x7f875413f9d0 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 >> v1:172.21.15.167:6789/0 conn(0x7f875413f9d0 legacy=0x7f87540ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8740003980 0x7f8740003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 0x7f87400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8740004d10 0x7f8740005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540b2290 con 0x7f8740004d10 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540b1580 con 0x7f8740003980 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874000b9c0 con 0x7f87540b1eb0 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8740004d10 0x7f8740005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f8752ffd640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8740003980 0x7f8740003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f874a7fc640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 0x7f87400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 -- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 msgr2=0x7f87400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b1eb0 0x7f87400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 -- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8740003980 msgr2=0x7f8740003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8740003980 0x7f8740003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.610+0000 7f87537fe640 1 -- 172.21.15.167:0/1957214949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740003530 con 0x7f8740004d10 2024-09-13T17:24:56.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8740004d10 0x7f8740005190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f874c00a780 tx=0x7f874c01fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3721735c0db42871 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0aa630 con 0x7f8740004d10 2024-09-13T17:24:56.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c0aa790 con 0x7f8740004d10 2024-09-13T17:24:56.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87527fc640 1 -- 172.21.15.167:0/1957214949 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0aab40 con 0x7f8740004d10 2024-09-13T17:24:56.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- 172.21.15.167:0/1957214949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8740004d10 msgr2=0x7f8740005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 --2- 172.21.15.167:0/1957214949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8740004d10 0x7f8740005190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f874c00a780 tx=0x7f874c01fa00 comp rx=0 tx=0).stop 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 -- 172.21.15.167:0/1957214949 reap_dead start 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- 172.21.15.167:0/1957214949 shutdown_connections 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- 172.21.15.167:0/1957214949 >> 172.21.15.167:0/1957214949 conn(0x7f87540b7250 msgr2=0x7f87540b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- 172.21.15.167:0/1957214949 shutdown_connections 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- 172.21.15.167:0/1957214949 wait complete. 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 Processor -- start 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- start start 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87541314e0 0x7f8754131f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8754133250 0x7f875412d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87541336b0 0x7f875412dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754132dc0 con 0x7f87541336b0 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540b7060 con 0x7f8754133250 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87541327b0 con 0x7f87541314e0 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87541336b0 0x7f875412dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87541336b0 0x7f875412dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44188/0 (socket says 172.21.15.167:44188) 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 -- 172.21.15.167:0/3166539641 learned_addr learned my addr 172.21.15.167:0/3166539641 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f874a7fc640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8754133250 0x7f875412d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8752ffd640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87541314e0 0x7f8754131f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 -- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87541314e0 msgr2=0x7f8754131f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87541314e0 0x7f8754131f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 -- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8754133250 msgr2=0x7f875412d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8754133250 0x7f875412d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 -- 172.21.15.167:0/3166539641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87541318c0 con 0x7f87541336b0 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f87537fe640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87541336b0 0x7f875412dad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f874c0202a0 tx=0x7f8740005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f874bfff640 1 -- 172.21.15.167:0/3166539641 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0b8070 con 0x7f87541336b0 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f874bfff640 1 -- 172.21.15.167:0/3166539641 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c001f40 con 0x7f87541336b0 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8754132a50 con 0x7f87541336b0 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f874bfff640 1 -- 172.21.15.167:0/3166539641 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0aa430 con 0x7f87541336b0 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.614+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875413d950 con 0x7f87541336b0 2024-09-13T17:24:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.618+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8754132be0 con 0x7f87541336b0 2024-09-13T17:24:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.618+0000 7f874bfff640 1 -- 172.21.15.167:0/3166539641 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f874c0017c0 con 0x7f87541336b0 2024-09-13T17:24:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.618+0000 7f874bfff640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8734066690 0x7f8734068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.618+0000 7f874bfff640 1 -- 172.21.15.167:0/3166539641 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f874c1221c0 con 0x7f87541336b0 2024-09-13T17:24:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.618+0000 7f8752ffd640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8734066690 0x7f8734068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.618+0000 7f8752ffd640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8734066690 0x7f8734068b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f87440099b0 tx=0x7f8744008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.622+0000 7f874bfff640 1 -- 172.21.15.167:0/3166539641 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f874c0ef1c0 con 0x7f87541336b0 2024-09-13T17:24:56.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.766+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f875406f320 con 0x7f8734066690 2024-09-13T17:24:56.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.794+0000 7f874bfff640 1 -- 172.21.15.167:0/3166539641 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368510 (secure 0 0 0) 0x7f8744013960 con 0x7f8734066690 2024-09-13T17:24:56.804 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:24:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:24:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8734066690 msgr2=0x7f8734068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8734066690 0x7f8734068b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f87440099b0 tx=0x7f8744008040 comp rx=0 tx=0).stop 2024-09-13T17:24:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87541336b0 msgr2=0x7f875412dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87541336b0 0x7f875412dad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f874c0202a0 tx=0x7f8740005800 comp rx=0 tx=0).stop 2024-09-13T17:24:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 shutdown_connections 2024-09-13T17:24:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8734066690 0x7f8734068b50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87541336b0 0x7f875412dad0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8754133250 0x7f875412d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 --2- 172.21.15.167:0/3166539641 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87541314e0 0x7f8754131f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 >> 172.21.15.167:0/3166539641 conn(0x7f87540b7250 msgr2=0x7f87540b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 shutdown_connections 2024-09-13T17:24:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.798+0000 7f8759560640 1 -- 172.21.15.167:0/3166539641 wait complete. 2024-09-13T17:24:56.819 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T17:24:55.575970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1408757,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":304,"num_write_kb":3290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221348,"kb_used_data":5220,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753372,"statfs":{"total":773094113280,"available":772867452928,"internally_reserved":0,"allocated":5345280,"data_stored":3814953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23093,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003919"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712812+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:21:32.712812+0000","last_peered":"2024-09-13T17:21:32.712812+0000","last_clean":"2024-09-13T17:21:32.712812+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:21:32.712812+0000","last_undegraded":"2024-09-13T17:21:32.712812+0000","last_fullsized":"2024-09-13T17:21:32.712812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.549720+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:22:53.549720+0000","last_peered":"2024-09-13T17:22:53.549720+0000","last_clean":"2024-09-13T17:22:53.549720+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:22:53.549720+0000","last_undegraded":"2024-09-13T17:22:53.549720+0000","last_fullsized":"2024-09-13T17:22:53.549720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709835+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:21:32.709835+0000","last_peered":"2024-09-13T17:21:32.709835+0000","last_clean":"2024-09-13T17:21:32.709835+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:21:32.709835+0000","last_undegraded":"2024-09-13T17:21:32.709835+0000","last_fullsized":"2024-09-13T17:21:32.709835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.549774+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:22:53.549774+0000","last_peered":"2024-09-13T17:22:53.549774+0000","last_clean":"2024-09-13T17:22:53.549774+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:22:53.549774+0000","last_undegraded":"2024-09-13T17:22:53.549774+0000","last_fullsized":"2024-09-13T17:22:53.549774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712492+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:21:32.712492+0000","last_peered":"2024-09-13T17:21:32.712492+0000","last_clean":"2024-09-13T17:21:32.712492+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:21:32.712492+0000","last_undegraded":"2024-09-13T17:21:32.712492+0000","last_fullsized":"2024-09-13T17:21:32.712492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715058+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:21:32.715058+0000","last_peered":"2024-09-13T17:21:32.715058+0000","last_clean":"2024-09-13T17:21:32.715058+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:21:32.715058+0000","last_undegraded":"2024-09-13T17:21:32.715058+0000","last_fullsized":"2024-09-13T17:21:32.715058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.030817+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:22:41.030817+0000","last_peered":"2024-09-13T17:22:41.030817+0000","last_clean":"2024-09-13T17:22:41.030817+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:22:41.030817+0000","last_undegraded":"2024-09-13T17:22:41.030817+0000","last_fullsized":"2024-09-13T17:22:41.030817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.720891+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:21:32.720891+0000","last_peered":"2024-09-13T17:21:32.720891+0000","last_clean":"2024-09-13T17:21:32.720891+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:21:32.720891+0000","last_undegraded":"2024-09-13T17:21:32.720891+0000","last_fullsized":"2024-09-13T17:21:32.720891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715545+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:21:32.715545+0000","last_peered":"2024-09-13T17:21:32.715545+0000","last_clean":"2024-09-13T17:21:32.715545+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:21:32.715545+0000","last_undegraded":"2024-09-13T17:21:32.715545+0000","last_fullsized":"2024-09-13T17:21:32.715545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.557212+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:23:23.557212+0000","last_peered":"2024-09-13T17:23:23.557212+0000","last_clean":"2024-09-13T17:23:23.557212+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:23:23.557212+0000","last_undegraded":"2024-09-13T17:23:23.557212+0000","last_fullsized":"2024-09-13T17:23:23.557212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721716+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:21:32.721716+0000","last_peered":"2024-09-13T17:21:32.721716+0000","last_clean":"2024-09-13T17:21:32.721716+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:21:32.721716+0000","last_undegraded":"2024-09-13T17:21:32.721716+0000","last_fullsized":"2024-09-13T17:21:32.721716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715495+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:21:32.715495+0000","last_peered":"2024-09-13T17:21:32.715495+0000","last_clean":"2024-09-13T17:21:32.715495+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:21:32.715495+0000","last_undegraded":"2024-09-13T17:21:32.715495+0000","last_fullsized":"2024-09-13T17:21:32.715495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373334+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:21:33.373334+0000","last_peered":"2024-09-13T17:21:33.373334+0000","last_clean":"2024-09-13T17:21:33.373334+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:21:33.373334+0000","last_undegraded":"2024-09-13T17:21:33.373334+0000","last_fullsized":"2024-09-13T17:21:33.373334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.044555+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:22:51.044555+0000","last_peered":"2024-09-13T17:22:51.044555+0000","last_clean":"2024-09-13T17:22:51.044555+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:22:51.044555+0000","last_undegraded":"2024-09-13T17:22:51.044555+0000","last_fullsized":"2024-09-13T17:22:51.044555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.716876+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:21:32.716876+0000","last_peered":"2024-09-13T17:21:32.716876+0000","last_clean":"2024-09-13T17:21:32.716876+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:21:32.716876+0000","last_undegraded":"2024-09-13T17:21:32.716876+0000","last_fullsized":"2024-09-13T17:21:32.716876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713629+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:21:32.713629+0000","last_peered":"2024-09-13T17:21:32.713629+0000","last_clean":"2024-09-13T17:21:32.713629+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:21:32.713629+0000","last_undegraded":"2024-09-13T17:21:32.713629+0000","last_fullsized":"2024-09-13T17:21:32.713629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780740+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:21:32.780740+0000","last_peered":"2024-09-13T17:21:32.780740+0000","last_clean":"2024-09-13T17:21:32.780740+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:21:32.780740+0000","last_undegraded":"2024-09-13T17:21:32.780740+0000","last_fullsized":"2024-09-13T17:21:32.780740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717428+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:21:32.717428+0000","last_peered":"2024-09-13T17:21:32.717428+0000","last_clean":"2024-09-13T17:21:32.717428+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:21:32.717428+0000","last_undegraded":"2024-09-13T17:21:32.717428+0000","last_fullsized":"2024-09-13T17:21:32.717428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710241+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:21:32.710241+0000","last_peered":"2024-09-13T17:21:32.710241+0000","last_clean":"2024-09-13T17:21:32.710241+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:21:32.710241+0000","last_undegraded":"2024-09-13T17:21:32.710241+0000","last_fullsized":"2024-09-13T17:21:32.710241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.041977+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:22:51.041977+0000","last_peered":"2024-09-13T17:22:51.041977+0000","last_clean":"2024-09-13T17:22:51.041977+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:22:51.041977+0000","last_undegraded":"2024-09-13T17:22:51.041977+0000","last_fullsized":"2024-09-13T17:22:51.041977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781403+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:21:32.781403+0000","last_peered":"2024-09-13T17:21:32.781403+0000","last_clean":"2024-09-13T17:21:32.781403+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:21:32.781403+0000","last_undegraded":"2024-09-13T17:21:32.781403+0000","last_fullsized":"2024-09-13T17:21:32.781403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715766+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:21:32.715766+0000","last_peered":"2024-09-13T17:21:32.715766+0000","last_clean":"2024-09-13T17:21:32.715766+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:21:32.715766+0000","last_undegraded":"2024-09-13T17:21:32.715766+0000","last_fullsized":"2024-09-13T17:21:32.715766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043779+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:22:51.043779+0000","last_peered":"2024-09-13T17:22:51.043779+0000","last_clean":"2024-09-13T17:22:51.043779+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:22:51.043779+0000","last_undegraded":"2024-09-13T17:22:51.043779+0000","last_fullsized":"2024-09-13T17:22:51.043779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.377950+0000","last_change":"2024-09-13T17:21:33.376826+0000","last_active":"2024-09-13T17:21:33.377950+0000","last_peered":"2024-09-13T17:21:33.377950+0000","last_clean":"2024-09-13T17:21:33.377950+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:21:33.377950+0000","last_undegraded":"2024-09-13T17:21:33.377950+0000","last_fullsized":"2024-09-13T17:21:33.377950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:39.885449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712490+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:21:32.712490+0000","last_peered":"2024-09-13T17:21:32.712490+0000","last_clean":"2024-09-13T17:21:32.712490+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:21:32.712490+0000","last_undegraded":"2024-09-13T17:21:32.712490+0000","last_fullsized":"2024-09-13T17:21:32.712490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047002+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:22:51.047002+0000","last_peered":"2024-09-13T17:22:51.047002+0000","last_clean":"2024-09-13T17:22:51.047002+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:22:51.047002+0000","last_undegraded":"2024-09-13T17:22:51.047002+0000","last_fullsized":"2024-09-13T17:22:51.047002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715303+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:21:32.715303+0000","last_peered":"2024-09-13T17:21:32.715303+0000","last_clean":"2024-09-13T17:21:32.715303+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:21:32.715303+0000","last_undegraded":"2024-09-13T17:21:32.715303+0000","last_fullsized":"2024-09-13T17:21:32.715303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715332+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:21:32.715332+0000","last_peered":"2024-09-13T17:21:32.715332+0000","last_clean":"2024-09-13T17:21:32.715332+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:21:32.715332+0000","last_undegraded":"2024-09-13T17:21:32.715332+0000","last_fullsized":"2024-09-13T17:21:32.715332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'21","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:59.882120+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:23:59.882120+0000","last_peered":"2024-09-13T17:23:59.882120+0000","last_clean":"2024-09-13T17:23:59.882120+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:23:59.882120+0000","last_undegraded":"2024-09-13T17:23:59.882120+0000","last_fullsized":"2024-09-13T17:23:59.882120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709522+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:21:32.709522+0000","last_peered":"2024-09-13T17:21:32.709522+0000","last_clean":"2024-09-13T17:21:32.709522+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:21:32.709522+0000","last_undegraded":"2024-09-13T17:21:32.709522+0000","last_fullsized":"2024-09-13T17:21:32.709522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.543105+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:22:58.543105+0000","last_peered":"2024-09-13T17:22:58.543105+0000","last_clean":"2024-09-13T17:22:58.543105+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:22:58.543105+0000","last_undegraded":"2024-09-13T17:22:58.543105+0000","last_fullsized":"2024-09-13T17:22:58.543105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.031459+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:22:41.031459+0000","last_peered":"2024-09-13T17:22:41.031459+0000","last_clean":"2024-09-13T17:22:41.031459+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:22:41.031459+0000","last_undegraded":"2024-09-13T17:22:41.031459+0000","last_fullsized":"2024-09-13T17:22:41.031459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:50.928673+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:23:50.928673+0000","last_peered":"2024-09-13T17:23:50.928673+0000","last_clean":"2024-09-13T17:23:50.928673+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:23:50.928673+0000","last_undegraded":"2024-09-13T17:23:50.928673+0000","last_fullsized":"2024-09-13T17:23:50.928673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.785217+0000","last_change":"2024-09-13T17:21:32.783988+0000","last_active":"2024-09-13T17:21:32.785217+0000","last_peered":"2024-09-13T17:21:32.785217+0000","last_clean":"2024-09-13T17:21:32.785217+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:21:32.785217+0000","last_undegraded":"2024-09-13T17:21:32.785217+0000","last_fullsized":"2024-09-13T17:21:32.785217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:39.042962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780985+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:21:32.780985+0000","last_peered":"2024-09-13T17:21:32.780985+0000","last_clean":"2024-09-13T17:21:32.780985+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:21:32.780985+0000","last_undegraded":"2024-09-13T17:21:32.780985+0000","last_fullsized":"2024-09-13T17:21:32.780985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780248+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:21:32.780248+0000","last_peered":"2024-09-13T17:21:32.780248+0000","last_clean":"2024-09-13T17:21:32.780248+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:21:32.780248+0000","last_undegraded":"2024-09-13T17:21:32.780248+0000","last_fullsized":"2024-09-13T17:21:32.780248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.550986+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:22:58.550986+0000","last_peered":"2024-09-13T17:22:58.550986+0000","last_clean":"2024-09-13T17:22:58.550986+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:22:58.550986+0000","last_undegraded":"2024-09-13T17:22:58.550986+0000","last_fullsized":"2024-09-13T17:22:58.550986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.034077+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:22:46.034077+0000","last_peered":"2024-09-13T17:22:46.034077+0000","last_clean":"2024-09-13T17:22:46.034077+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:22:46.034077+0000","last_undegraded":"2024-09-13T17:22:46.034077+0000","last_fullsized":"2024-09-13T17:22:46.034077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:50.314123+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:24:50.314123+0000","last_peered":"2024-09-13T17:24:50.314123+0000","last_clean":"2024-09-13T17:24:50.314123+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:24:50.314123+0000","last_undegraded":"2024-09-13T17:24:50.314123+0000","last_fullsized":"2024-09-13T17:24:50.314123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.541951+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:22:53.541951+0000","last_peered":"2024-09-13T17:22:53.541951+0000","last_clean":"2024-09-13T17:22:53.541951+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:22:53.541951+0000","last_undegraded":"2024-09-13T17:22:53.541951+0000","last_fullsized":"2024-09-13T17:22:53.541951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'18","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:56.078682+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:23:56.078682+0000","last_peered":"2024-09-13T17:23:56.078682+0000","last_clean":"2024-09-13T17:23:56.078682+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:23:56.078682+0000","last_undegraded":"2024-09-13T17:23:56.078682+0000","last_fullsized":"2024-09-13T17:23:56.078682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:09.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10613,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":19,"num_write":12,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781623+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:21:32.781623+0000","last_peered":"2024-09-13T17:21:32.781623+0000","last_clean":"2024-09-13T17:21:32.781623+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:21:32.781623+0000","last_undegraded":"2024-09-13T17:21:32.781623+0000","last_fullsized":"2024-09-13T17:21:32.781623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711531+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:21:32.711531+0000","last_peered":"2024-09-13T17:21:32.711531+0000","last_clean":"2024-09-13T17:21:32.711531+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:21:32.711531+0000","last_undegraded":"2024-09-13T17:21:32.711531+0000","last_fullsized":"2024-09-13T17:21:32.711531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.550732+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:22:53.550732+0000","last_peered":"2024-09-13T17:22:53.550732+0000","last_clean":"2024-09-13T17:22:53.550732+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:22:53.550732+0000","last_undegraded":"2024-09-13T17:22:53.550732+0000","last_fullsized":"2024-09-13T17:22:53.550732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.206492+0000","last_change":"2024-09-13T17:21:33.205535+0000","last_active":"2024-09-13T17:21:33.206492+0000","last_peered":"2024-09-13T17:21:33.206492+0000","last_clean":"2024-09-13T17:21:33.206492+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:21:33.206492+0000","last_undegraded":"2024-09-13T17:21:33.206492+0000","last_fullsized":"2024-09-13T17:21:33.206492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:01.951295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.790078+0000","last_change":"2024-09-13T17:21:32.786124+0000","last_active":"2024-09-13T17:21:32.790078+0000","last_peered":"2024-09-13T17:21:32.790078+0000","last_clean":"2024-09-13T17:21:32.790078+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:21:32.790078+0000","last_undegraded":"2024-09-13T17:21:32.790078+0000","last_fullsized":"2024-09-13T17:21:32.790078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:04.040678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043912+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:22:51.043912+0000","last_peered":"2024-09-13T17:22:51.043912+0000","last_clean":"2024-09-13T17:22:51.043912+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:22:51.043912+0000","last_undegraded":"2024-09-13T17:22:51.043912+0000","last_fullsized":"2024-09-13T17:22:51.043912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:43.548854+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:22:43.548854+0000","last_peered":"2024-09-13T17:22:43.548854+0000","last_clean":"2024-09-13T17:22:43.548854+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:22:43.548854+0000","last_undegraded":"2024-09-13T17:22:43.548854+0000","last_fullsized":"2024-09-13T17:22:43.548854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373613+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:21:33.373613+0000","last_peered":"2024-09-13T17:21:33.373613+0000","last_clean":"2024-09-13T17:21:33.373613+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:21:33.373613+0000","last_undegraded":"2024-09-13T17:21:33.373613+0000","last_fullsized":"2024-09-13T17:21:33.373613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201783+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:21:33.201783+0000","last_peered":"2024-09-13T17:21:33.201783+0000","last_clean":"2024-09-13T17:21:33.201783+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:21:33.201783+0000","last_undegraded":"2024-09-13T17:21:33.201783+0000","last_fullsized":"2024-09-13T17:21:33.201783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043713+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:22:51.043713+0000","last_peered":"2024-09-13T17:22:51.043713+0000","last_clean":"2024-09-13T17:22:51.043713+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:22:51.043713+0000","last_undegraded":"2024-09-13T17:22:51.043713+0000","last_fullsized":"2024-09-13T17:22:51.043713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373267+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:21:33.373267+0000","last_peered":"2024-09-13T17:21:33.373267+0000","last_clean":"2024-09-13T17:21:33.373267+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:21:33.373267+0000","last_undegraded":"2024-09-13T17:21:33.373267+0000","last_fullsized":"2024-09-13T17:21:33.373267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721076+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:21:32.721076+0000","last_peered":"2024-09-13T17:21:32.721076+0000","last_clean":"2024-09-13T17:21:32.721076+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:21:32.721076+0000","last_undegraded":"2024-09-13T17:21:32.721076+0000","last_fullsized":"2024-09-13T17:21:32.721076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.042941+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:22:51.042941+0000","last_peered":"2024-09-13T17:22:51.042941+0000","last_clean":"2024-09-13T17:22:51.042941+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:22:51.042941+0000","last_undegraded":"2024-09-13T17:22:51.042941+0000","last_fullsized":"2024-09-13T17:22:51.042941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712372+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:21:32.712372+0000","last_peered":"2024-09-13T17:21:32.712372+0000","last_clean":"2024-09-13T17:21:32.712372+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:21:32.712372+0000","last_undegraded":"2024-09-13T17:21:32.712372+0000","last_fullsized":"2024-09-13T17:21:32.712372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.202208+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:21:33.202208+0000","last_peered":"2024-09-13T17:21:33.202208+0000","last_clean":"2024-09-13T17:21:33.202208+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:21:33.202208+0000","last_undegraded":"2024-09-13T17:21:33.202208+0000","last_fullsized":"2024-09-13T17:21:33.202208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.045308+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:22:51.045308+0000","last_peered":"2024-09-13T17:22:51.045308+0000","last_clean":"2024-09-13T17:22:51.045308+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:22:51.045308+0000","last_undegraded":"2024-09-13T17:22:51.045308+0000","last_fullsized":"2024-09-13T17:22:51.045308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:33.533450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717513+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:21:32.717513+0000","last_peered":"2024-09-13T17:21:32.717513+0000","last_clean":"2024-09-13T17:21:32.717513+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:21:32.717513+0000","last_undegraded":"2024-09-13T17:21:32.717513+0000","last_fullsized":"2024-09-13T17:21:32.717513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519587+0000","last_change":"2024-09-13T17:21:32.725077+0000","last_active":"2024-09-13T17:21:36.519587+0000","last_peered":"2024-09-13T17:21:36.519587+0000","last_clean":"2024-09-13T17:21:36.519587+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:21:36.519587+0000","last_undegraded":"2024-09-13T17:21:36.519587+0000","last_fullsized":"2024-09-13T17:21:36.519587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:17.569869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043971+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:22:51.043971+0000","last_peered":"2024-09-13T17:22:51.043971+0000","last_clean":"2024-09-13T17:22:51.043971+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:22:51.043971+0000","last_undegraded":"2024-09-13T17:22:51.043971+0000","last_fullsized":"2024-09-13T17:22:51.043971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715050+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:21:32.715050+0000","last_peered":"2024-09-13T17:21:32.715050+0000","last_clean":"2024-09-13T17:21:32.715050+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:21:32.715050+0000","last_undegraded":"2024-09-13T17:21:32.715050+0000","last_fullsized":"2024-09-13T17:21:32.715050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201878+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:21:33.201878+0000","last_peered":"2024-09-13T17:21:33.201878+0000","last_clean":"2024-09-13T17:21:33.201878+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:21:33.201878+0000","last_undegraded":"2024-09-13T17:21:33.201878+0000","last_fullsized":"2024-09-13T17:21:33.201878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.042768+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:22:51.042768+0000","last_peered":"2024-09-13T17:22:51.042768+0000","last_clean":"2024-09-13T17:22:51.042768+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:22:51.042768+0000","last_undegraded":"2024-09-13T17:22:51.042768+0000","last_fullsized":"2024-09-13T17:22:51.042768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:25.139372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711905+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:21:32.711905+0000","last_peered":"2024-09-13T17:21:32.711905+0000","last_clean":"2024-09-13T17:21:32.711905+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:21:32.711905+0000","last_undegraded":"2024-09-13T17:21:32.711905+0000","last_fullsized":"2024-09-13T17:21:32.711905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373494+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:21:33.373494+0000","last_peered":"2024-09-13T17:21:33.373494+0000","last_clean":"2024-09-13T17:21:33.373494+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:21:33.373494+0000","last_undegraded":"2024-09-13T17:21:33.373494+0000","last_fullsized":"2024-09-13T17:21:33.373494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047765+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:22:51.047765+0000","last_peered":"2024-09-13T17:22:51.047765+0000","last_clean":"2024-09-13T17:22:51.047765+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:22:51.047765+0000","last_undegraded":"2024-09-13T17:22:51.047765+0000","last_fullsized":"2024-09-13T17:22:51.047765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715067+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:21:32.715067+0000","last_peered":"2024-09-13T17:21:32.715067+0000","last_clean":"2024-09-13T17:21:32.715067+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:21:32.715067+0000","last_undegraded":"2024-09-13T17:21:32.715067+0000","last_fullsized":"2024-09-13T17:21:32.715067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201601+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:21:33.201601+0000","last_peered":"2024-09-13T17:21:33.201601+0000","last_clean":"2024-09-13T17:21:33.201601+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:21:33.201601+0000","last_undegraded":"2024-09-13T17:21:33.201601+0000","last_fullsized":"2024-09-13T17:21:33.201601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046511+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:22:51.046511+0000","last_peered":"2024-09-13T17:22:51.046511+0000","last_clean":"2024-09-13T17:22:51.046511+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:22:51.046511+0000","last_undegraded":"2024-09-13T17:22:51.046511+0000","last_fullsized":"2024-09-13T17:22:51.046511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713774+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:21:32.713774+0000","last_peered":"2024-09-13T17:21:32.713774+0000","last_clean":"2024-09-13T17:21:32.713774+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:21:32.713774+0000","last_undegraded":"2024-09-13T17:21:32.713774+0000","last_fullsized":"2024-09-13T17:21:32.713774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712593+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:21:32.712593+0000","last_peered":"2024-09-13T17:21:32.712593+0000","last_clean":"2024-09-13T17:21:32.712593+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:21:32.712593+0000","last_undegraded":"2024-09-13T17:21:32.712593+0000","last_fullsized":"2024-09-13T17:21:32.712593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.028553+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:22:41.028553+0000","last_peered":"2024-09-13T17:22:41.028553+0000","last_clean":"2024-09-13T17:22:41.028553+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:22:41.028553+0000","last_undegraded":"2024-09-13T17:22:41.028553+0000","last_fullsized":"2024-09-13T17:22:41.028553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721562+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:21:32.721562+0000","last_peered":"2024-09-13T17:21:32.721562+0000","last_clean":"2024-09-13T17:21:32.721562+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:21:32.721562+0000","last_undegraded":"2024-09-13T17:21:32.721562+0000","last_fullsized":"2024-09-13T17:21:32.721562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201631+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:21:33.201631+0000","last_peered":"2024-09-13T17:21:33.201631+0000","last_clean":"2024-09-13T17:21:33.201631+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:21:33.201631+0000","last_undegraded":"2024-09-13T17:21:33.201631+0000","last_fullsized":"2024-09-13T17:21:33.201631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'57","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:50.418915+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:24:50.418915+0000","last_peered":"2024-09-13T17:24:50.418915+0000","last_clean":"2024-09-13T17:24:50.418915+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:24:50.418915+0000","last_undegraded":"2024-09-13T17:24:50.418915+0000","last_fullsized":"2024-09-13T17:24:50.418915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":806978,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780411+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:21:32.780411+0000","last_peered":"2024-09-13T17:21:32.780411+0000","last_clean":"2024-09-13T17:21:32.780411+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:21:32.780411+0000","last_undegraded":"2024-09-13T17:21:32.780411+0000","last_fullsized":"2024-09-13T17:21:32.780411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717981+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:21:32.717981+0000","last_peered":"2024-09-13T17:21:32.717981+0000","last_clean":"2024-09-13T17:21:32.717981+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:21:32.717981+0000","last_undegraded":"2024-09-13T17:21:32.717981+0000","last_fullsized":"2024-09-13T17:21:32.717981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'14","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:52.126340+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:24:52.126340+0000","last_peered":"2024-09-13T17:24:52.126340+0000","last_clean":"2024-09-13T17:24:52.126340+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:24:52.126340+0000","last_undegraded":"2024-09-13T17:24:52.126340+0000","last_fullsized":"2024-09-13T17:24:52.126340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715770+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:21:32.715770+0000","last_peered":"2024-09-13T17:21:32.715770+0000","last_clean":"2024-09-13T17:21:32.715770+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:21:32.715770+0000","last_undegraded":"2024-09-13T17:21:32.715770+0000","last_fullsized":"2024-09-13T17:21:32.715770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519675+0000","last_change":"2024-09-13T17:21:32.722613+0000","last_active":"2024-09-13T17:21:36.519675+0000","last_peered":"2024-09-13T17:21:36.519675+0000","last_clean":"2024-09-13T17:21:36.519675+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:21:36.519675+0000","last_undegraded":"2024-09-13T17:21:36.519675+0000","last_fullsized":"2024-09-13T17:21:36.519675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:48.677916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047585+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:22:51.047585+0000","last_peered":"2024-09-13T17:22:51.047585+0000","last_clean":"2024-09-13T17:22:51.047585+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:22:51.047585+0000","last_undegraded":"2024-09-13T17:22:51.047585+0000","last_fullsized":"2024-09-13T17:22:51.047585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709825+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:21:32.709825+0000","last_peered":"2024-09-13T17:21:32.709825+0000","last_clean":"2024-09-13T17:21:32.709825+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:21:32.709825+0000","last_undegraded":"2024-09-13T17:21:32.709825+0000","last_fullsized":"2024-09-13T17:21:32.709825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721834+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:21:32.721834+0000","last_peered":"2024-09-13T17:21:32.721834+0000","last_clean":"2024-09-13T17:21:32.721834+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:21:32.721834+0000","last_undegraded":"2024-09-13T17:21:32.721834+0000","last_fullsized":"2024-09-13T17:21:32.721834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046749+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:22:51.046749+0000","last_peered":"2024-09-13T17:22:51.046749+0000","last_clean":"2024-09-13T17:22:51.046749+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:22:51.046749+0000","last_undegraded":"2024-09-13T17:22:51.046749+0000","last_fullsized":"2024-09-13T17:22:51.046749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710043+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:21:32.710043+0000","last_peered":"2024-09-13T17:21:32.710043+0000","last_clean":"2024-09-13T17:21:32.710043+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:21:32.710043+0000","last_undegraded":"2024-09-13T17:21:32.710043+0000","last_fullsized":"2024-09-13T17:21:32.710043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711841+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:21:32.711841+0000","last_peered":"2024-09-13T17:21:32.711841+0000","last_clean":"2024-09-13T17:21:32.711841+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:21:32.711841+0000","last_undegraded":"2024-09-13T17:21:32.711841+0000","last_fullsized":"2024-09-13T17:21:32.711841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.779844+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:21:32.779844+0000","last_peered":"2024-09-13T17:21:32.779844+0000","last_clean":"2024-09-13T17:21:32.779844+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:21:32.779844+0000","last_undegraded":"2024-09-13T17:21:32.779844+0000","last_fullsized":"2024-09-13T17:21:32.779844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046252+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:22:51.046252+0000","last_peered":"2024-09-13T17:22:51.046252+0000","last_clean":"2024-09-13T17:22:51.046252+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:22:51.046252+0000","last_undegraded":"2024-09-13T17:22:51.046252+0000","last_fullsized":"2024-09-13T17:22:51.046252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374293+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:21:33.374293+0000","last_peered":"2024-09-13T17:21:33.374293+0000","last_clean":"2024-09-13T17:21:33.374293+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:21:33.374293+0000","last_undegraded":"2024-09-13T17:21:33.374293+0000","last_fullsized":"2024-09-13T17:21:33.374293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710039+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:21:32.710039+0000","last_peered":"2024-09-13T17:21:32.710039+0000","last_clean":"2024-09-13T17:21:32.710039+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:21:32.710039+0000","last_undegraded":"2024-09-13T17:21:32.710039+0000","last_fullsized":"2024-09-13T17:21:32.710039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046569+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:22:51.046569+0000","last_peered":"2024-09-13T17:22:51.046569+0000","last_clean":"2024-09-13T17:22:51.046569+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:22:51.046569+0000","last_undegraded":"2024-09-13T17:22:51.046569+0000","last_fullsized":"2024-09-13T17:22:51.046569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.032396+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:22:46.032396+0000","last_peered":"2024-09-13T17:22:46.032396+0000","last_clean":"2024-09-13T17:22:46.032396+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:22:46.032396+0000","last_undegraded":"2024-09-13T17:22:46.032396+0000","last_fullsized":"2024-09-13T17:22:46.032396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712613+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:21:32.712613+0000","last_peered":"2024-09-13T17:21:32.712613+0000","last_clean":"2024-09-13T17:21:32.712613+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:21:32.712613+0000","last_undegraded":"2024-09-13T17:21:32.712613+0000","last_fullsized":"2024-09-13T17:21:32.712613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717613+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:21:32.717613+0000","last_peered":"2024-09-13T17:21:32.717613+0000","last_clean":"2024-09-13T17:21:32.717613+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:21:32.717613+0000","last_undegraded":"2024-09-13T17:21:32.717613+0000","last_fullsized":"2024-09-13T17:21:32.717613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:31.608726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.027160+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:22:41.027160+0000","last_peered":"2024-09-13T17:22:41.027160+0000","last_clean":"2024-09-13T17:22:41.027160+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:22:41.027160+0000","last_undegraded":"2024-09-13T17:22:41.027160+0000","last_fullsized":"2024-09-13T17:22:41.027160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715927+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:21:32.715927+0000","last_peered":"2024-09-13T17:21:32.715927+0000","last_clean":"2024-09-13T17:21:32.715927+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:21:32.715927+0000","last_undegraded":"2024-09-13T17:21:32.715927+0000","last_fullsized":"2024-09-13T17:21:32.715927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.726286+0000","last_change":"2024-09-13T17:21:32.724190+0000","last_active":"2024-09-13T17:21:32.726286+0000","last_peered":"2024-09-13T17:21:32.726286+0000","last_clean":"2024-09-13T17:21:32.726286+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:21:32.726286+0000","last_undegraded":"2024-09-13T17:21:32.726286+0000","last_fullsized":"2024-09-13T17:21:32.726286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:48.005131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373229+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:21:33.373229+0000","last_peered":"2024-09-13T17:21:33.373229+0000","last_clean":"2024-09-13T17:21:33.373229+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:21:33.373229+0000","last_undegraded":"2024-09-13T17:21:33.373229+0000","last_fullsized":"2024-09-13T17:21:33.373229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717837+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:21:32.717837+0000","last_peered":"2024-09-13T17:21:32.717837+0000","last_clean":"2024-09-13T17:21:32.717837+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:21:32.717837+0000","last_undegraded":"2024-09-13T17:21:32.717837+0000","last_fullsized":"2024-09-13T17:21:32.717837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:44.697368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.719820+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:21:32.719820+0000","last_peered":"2024-09-13T17:21:32.719820+0000","last_clean":"2024-09-13T17:21:32.719820+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:21:32.719820+0000","last_undegraded":"2024-09-13T17:21:32.719820+0000","last_fullsized":"2024-09-13T17:21:32.719820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712462+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:21:32.712462+0000","last_peered":"2024-09-13T17:21:32.712462+0000","last_clean":"2024-09-13T17:21:32.712462+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:21:32.712462+0000","last_undegraded":"2024-09-13T17:21:32.712462+0000","last_fullsized":"2024-09-13T17:21:32.712462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.714328+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:21:32.714328+0000","last_peered":"2024-09-13T17:21:32.714328+0000","last_clean":"2024-09-13T17:21:32.714328+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:21:32.714328+0000","last_undegraded":"2024-09-13T17:21:32.714328+0000","last_fullsized":"2024-09-13T17:21:32.714328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780794+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:21:32.780794+0000","last_peered":"2024-09-13T17:21:32.780794+0000","last_clean":"2024-09-13T17:21:32.780794+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:21:32.780794+0000","last_undegraded":"2024-09-13T17:21:32.780794+0000","last_fullsized":"2024-09-13T17:21:32.780794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374611+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:21:33.374611+0000","last_peered":"2024-09-13T17:21:33.374611+0000","last_clean":"2024-09-13T17:21:33.374611+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:21:33.374611+0000","last_undegraded":"2024-09-13T17:21:33.374611+0000","last_fullsized":"2024-09-13T17:21:33.374611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715221+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:21:32.715221+0000","last_peered":"2024-09-13T17:21:32.715221+0000","last_clean":"2024-09-13T17:21:32.715221+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:21:32.715221+0000","last_undegraded":"2024-09-13T17:21:32.715221+0000","last_fullsized":"2024-09-13T17:21:32.715221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.718384+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:21:32.718384+0000","last_peered":"2024-09-13T17:21:32.718384+0000","last_clean":"2024-09-13T17:21:32.718384+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:21:32.718384+0000","last_undegraded":"2024-09-13T17:21:32.718384+0000","last_fullsized":"2024-09-13T17:21:32.718384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710471+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:21:32.710471+0000","last_peered":"2024-09-13T17:21:32.710471+0000","last_clean":"2024-09-13T17:21:32.710471+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:21:32.710471+0000","last_undegraded":"2024-09-13T17:21:32.710471+0000","last_fullsized":"2024-09-13T17:21:32.710471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.719661+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:21:32.719661+0000","last_peered":"2024-09-13T17:21:32.719661+0000","last_clean":"2024-09-13T17:21:32.719661+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:21:32.719661+0000","last_undegraded":"2024-09-13T17:21:32.719661+0000","last_fullsized":"2024-09-13T17:21:32.719661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712107+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:21:32.712107+0000","last_peered":"2024-09-13T17:21:32.712107+0000","last_clean":"2024-09-13T17:21:32.712107+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:21:32.712107+0000","last_undegraded":"2024-09-13T17:21:32.712107+0000","last_fullsized":"2024-09-13T17:21:32.712107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374030+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:21:33.374030+0000","last_peered":"2024-09-13T17:21:33.374030+0000","last_clean":"2024-09-13T17:21:33.374030+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:21:33.374030+0000","last_undegraded":"2024-09-13T17:21:33.374030+0000","last_fullsized":"2024-09-13T17:21:33.374030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.202223+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:21:33.202223+0000","last_peered":"2024-09-13T17:21:33.202223+0000","last_clean":"2024-09-13T17:21:33.202223+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:21:33.202223+0000","last_undegraded":"2024-09-13T17:21:33.202223+0000","last_fullsized":"2024-09-13T17:21:33.202223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.720422+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:21:32.720422+0000","last_peered":"2024-09-13T17:21:32.720422+0000","last_clean":"2024-09-13T17:21:32.720422+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:21:32.720422+0000","last_undegraded":"2024-09-13T17:21:32.720422+0000","last_fullsized":"2024-09-13T17:21:32.720422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:03.506249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.722233+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:21:32.722233+0000","last_peered":"2024-09-13T17:21:32.722233+0000","last_clean":"2024-09-13T17:21:32.722233+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:21:32.722233+0000","last_undegraded":"2024-09-13T17:21:32.722233+0000","last_fullsized":"2024-09-13T17:21:32.722233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.718784+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:21:32.718784+0000","last_peered":"2024-09-13T17:21:32.718784+0000","last_clean":"2024-09-13T17:21:32.718784+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:21:32.718784+0000","last_undegraded":"2024-09-13T17:21:32.718784+0000","last_fullsized":"2024-09-13T17:21:32.718784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.779951+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:21:32.779951+0000","last_peered":"2024-09-13T17:21:32.779951+0000","last_clean":"2024-09-13T17:21:32.779951+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:21:32.779951+0000","last_undegraded":"2024-09-13T17:21:32.779951+0000","last_fullsized":"2024-09-13T17:21:32.779951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712325+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:21:32.712325+0000","last_peered":"2024-09-13T17:21:32.712325+0000","last_clean":"2024-09-13T17:21:32.712325+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:21:32.712325+0000","last_undegraded":"2024-09-13T17:21:32.712325+0000","last_fullsized":"2024-09-13T17:21:32.712325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713394+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:21:32.713394+0000","last_peered":"2024-09-13T17:21:32.713394+0000","last_clean":"2024-09-13T17:21:32.713394+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:21:32.713394+0000","last_undegraded":"2024-09-13T17:21:32.713394+0000","last_fullsized":"2024-09-13T17:21:32.713394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717783+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:21:32.717783+0000","last_peered":"2024-09-13T17:21:32.717783+0000","last_clean":"2024-09-13T17:21:32.717783+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:21:32.717783+0000","last_undegraded":"2024-09-13T17:21:32.717783+0000","last_fullsized":"2024-09-13T17:21:32.717783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374235+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:21:33.374235+0000","last_peered":"2024-09-13T17:21:33.374235+0000","last_clean":"2024-09-13T17:21:33.374235+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:21:33.374235+0000","last_undegraded":"2024-09-13T17:21:33.374235+0000","last_fullsized":"2024-09-13T17:21:33.374235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374509+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:21:33.374509+0000","last_peered":"2024-09-13T17:21:33.374509+0000","last_clean":"2024-09-13T17:21:33.374509+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:21:33.374509+0000","last_undegraded":"2024-09-13T17:21:33.374509+0000","last_fullsized":"2024-09-13T17:21:33.374509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201762+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:21:33.201762+0000","last_peered":"2024-09-13T17:21:33.201762+0000","last_clean":"2024-09-13T17:21:33.201762+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:21:33.201762+0000","last_undegraded":"2024-09-13T17:21:33.201762+0000","last_fullsized":"2024-09-13T17:21:33.201762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709799+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:21:32.709799+0000","last_peered":"2024-09-13T17:21:32.709799+0000","last_clean":"2024-09-13T17:21:32.709799+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:21:32.709799+0000","last_undegraded":"2024-09-13T17:21:32.709799+0000","last_fullsized":"2024-09-13T17:21:32.709799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201226+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:21:33.201226+0000","last_peered":"2024-09-13T17:21:33.201226+0000","last_clean":"2024-09-13T17:21:33.201226+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:21:33.201226+0000","last_undegraded":"2024-09-13T17:21:33.201226+0000","last_fullsized":"2024-09-13T17:21:33.201226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519499+0000","last_change":"2024-09-13T17:21:32.721986+0000","last_active":"2024-09-13T17:21:36.519499+0000","last_peered":"2024-09-13T17:21:36.519499+0000","last_clean":"2024-09-13T17:21:36.519499+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:21:36.519499+0000","last_undegraded":"2024-09-13T17:21:36.519499+0000","last_fullsized":"2024-09-13T17:21:36.519499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:04.661478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201356+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:21:33.201356+0000","last_peered":"2024-09-13T17:21:33.201356+0000","last_clean":"2024-09-13T17:21:33.201356+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:21:33.201356+0000","last_undegraded":"2024-09-13T17:21:33.201356+0000","last_fullsized":"2024-09-13T17:21:33.201356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.556068+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:22:53.556068+0000","last_peered":"2024-09-13T17:22:53.556068+0000","last_clean":"2024-09-13T17:22:53.556068+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:22:53.556068+0000","last_undegraded":"2024-09-13T17:22:53.556068+0000","last_fullsized":"2024-09-13T17:22:53.556068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712194+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:21:32.712194+0000","last_peered":"2024-09-13T17:21:32.712194+0000","last_clean":"2024-09-13T17:21:32.712194+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:21:32.712194+0000","last_undegraded":"2024-09-13T17:21:32.712194+0000","last_fullsized":"2024-09-13T17:21:32.712194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781454+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:21:32.781454+0000","last_peered":"2024-09-13T17:21:32.781454+0000","last_clean":"2024-09-13T17:21:32.781454+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:21:32.781454+0000","last_undegraded":"2024-09-13T17:21:32.781454+0000","last_fullsized":"2024-09-13T17:21:32.781454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201533+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:21:33.201533+0000","last_peered":"2024-09-13T17:21:33.201533+0000","last_clean":"2024-09-13T17:21:33.201533+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:21:33.201533+0000","last_undegraded":"2024-09-13T17:21:33.201533+0000","last_fullsized":"2024-09-13T17:21:33.201533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":818389,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":19,"num_write":139,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1695744,"data_stored":1637089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.86799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.081,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2150000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.92800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0660000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.04},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1379999999999999,"5min":1.216,"15min":1.216},"last":1.218}]},{"osd":2,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.29},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.84099999999999997},"min":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.526,"15min":1.526},"last":1.0589999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.91000000000000003,"15min":0.93799999999999994},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.165,"5min":1.23,"15min":1.23},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96699999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.109,"5min":1.365,"15min":1.365},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.109},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.167,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1859999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0720000000000001,"15min":1.1200000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.218,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.139},{"interface":"front","average":{"1min":1.046,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.88900000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2549999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.085}]}]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1122304,"data_stored":931107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.501,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1140000000000001,"5min":1.167,"15min":1.167},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.84199999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1379999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0720000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0880000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.997}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.875,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.181,"5min":1.615,"15min":1.615},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.268,"15min":1.268},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":2.149,"15min":2.149},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98999999999999999,"15min":1.018},"min":{"1min":0.70099999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1200000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.153}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.218,"5min":1.367,"15min":1.367},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0429999999999999,"15min":1.0669999999999999},"min":{"1min":0.68500000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.21,"5min":2.069,"15min":2.069},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.077},"min":{"1min":0.76300000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2150000000000001,"5min":1.964,"15min":1.964},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.997,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.73299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.619,"15min":1.619},"last":1.034}]}]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.232,"15min":1.232},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.84999999999999998},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.84599999999999997,"15min":0.86399999999999999},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.71999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.466,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97299999999999998,"15min":0.997},"min":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.276,"5min":1.339,"15min":1.339},"last":0.745}]},{"osd":4,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.97399999999999998,"15min":0.94999999999999996},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.075,"15min":1.1040000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":1.339,"15min":1.339},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.84299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.129,"15min":1.159},"min":{"1min":0.872,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0640000000000001,"15min":1.0940000000000001},"min":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83299999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.111,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.872},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.873,"15min":0.92700000000000005},"min":{"1min":0.505,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0049999999999999,"5min":1.611,"15min":1.611},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78800000000000003,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.879},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.1120000000000001,"5min":1.23,"15min":1.23},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90200000000000002,"15min":0.96899999999999997},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1020000000000001,"5min":1.754,"15min":1.754},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1990000000000001,"5min":1.268,"15min":1.268},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.92300000000000004,"15min":0.98299999999999998},"min":{"1min":0.68000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.78,"15min":1.78},"last":1.0089999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0960000000000001,"5min":1.694,"15min":1.694},"last":1.161},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.032,"15min":1.0840000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1399999999999999,"5min":1.907,"15min":1.907},"last":0.98599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.97899999999999998,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1299999999999999,"5min":1.53,"15min":1.53},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0509999999999999,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1539999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.0960000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.1220000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.137,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.089,"15min":1.147},"min":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1970000000000001,"5min":1.863,"15min":1.863},"last":1.0609999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1134592,"data_stored":942031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.78000000000000003,"5min":1.014,"15min":1.014},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.054,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.38}]},{"osd":1,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.66200000000000003},"min":{"1min":0.32000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.34599999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.93999999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.70499999999999996},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1060000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.71499999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.022,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.02,"5min":1.51,"15min":1.51},"last":1.024},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3300000000000001,"5min":1.421,"15min":1.421},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.61499999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1020000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96799999999999997,"15min":1.01},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.397,"5min":1.712,"15min":1.712},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3280000000000001,"5min":1.756,"15min":1.756},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94799999999999995,"15min":1.004},"min":{"1min":0.59499999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.248,"5min":1.946,"15min":1.946},"last":0.93899999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.61599999999999999},"min":{"1min":0.26000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.62,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.85199999999999998,"5min":1.466,"15min":1.466},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59399999999999997,"15min":0.622},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95199999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.29699999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.94099999999999995,"5min":1.419,"15min":1.419},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.72199999999999998},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91600000000000004,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.625,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.878,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1020000000000001,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91300000000000003,"15min":0.96699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2529999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":0.97999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2669999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3580000000000001,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95299999999999996,"15min":1.026},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3049999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":1.02},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.65000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3400000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.88700000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57599999999999996,"15min":0.626},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63800000000000001,"15min":0.66700000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.873,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89400000000000002,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":1.214,"5min":1.401,"15min":1.401},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.877},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.752},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.88700000000000001},"min":{"1min":0.57499999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.266,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88800000000000001,"15min":0.93899999999999995},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2709999999999999,"5min":1.365,"15min":1.365},"last":0.80800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86499999999999999,"15min":0.91700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1870000000000001,"5min":1.323,"15min":1.323},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.995},"min":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.23,"5min":1.639,"15min":1.639},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92600000000000005,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.528,"15min":1.528},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":138838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.58899999999999997},"min":{"1min":0.28399999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.60499999999999998},"min":{"1min":0.308,"5min":0.255,"15min":0.255},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83499999999999996,"5min":1.075,"15min":1.075},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.66200000000000003},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.749}]},{"osd":3,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60799999999999998,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.88400000000000001,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.72999999999999998},"min":{"1min":0.36199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.88200000000000001},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.153,"5min":1.351,"15min":1.351},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0109999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.878,"15min":0.93799999999999994},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.056,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1799999999999999,"5min":1.21,"15min":1.21},"last":0.82599999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.92200000000000004},"min":{"1min":0.56799999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1359999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.425,"15min":1.425},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.127,"5min":1.554,"15min":1.554},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92100000000000004,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1040000000000001,"5min":1.454,"15min":1.454},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":817902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":815104,"data_stored":806978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:24:56.826 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:24:56.826 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:24:56.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.970+0000 7f974b676640 1 Processor -- start 2024-09-13T17:24:56.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f974b676640 1 -- start start 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f974b676640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f974406f0f0 0x7f97440b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f974b676640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9744070ff0 0x7f974414e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f974b676640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9744071b10 con 0x7f9744070bb0 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f974b676640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974406f7f0 con 0x7f9744070ff0 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f974b676640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97440b0ea0 con 0x7f974406f0f0 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9749c13640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9744070ff0 0x7f974414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9748c11640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9744070bb0 0x7f974413d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52130/0 (socket says 172.21.15.167:52130) 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9748c11640 1 -- 172.21.15.167:0/514972253 learned_addr learned my addr 172.21.15.167:0/514972253 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9749412640 1 --2- 172.21.15.167:0/514972253 >> v2:172.21.15.190:3300/0 conn(0x7f974406f0f0 0x7f97440b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9749c13640 1 -- 172.21.15.167:0/514972253 >> v2:172.21.15.190:3300/0 conn(0x7f974406f0f0 msgr2=0x7f97440b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9749c13640 1 --2- 172.21.15.167:0/514972253 >> v2:172.21.15.190:3300/0 conn(0x7f974406f0f0 0x7f97440b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9749c13640 1 -- 172.21.15.167:0/514972253 >> v1:172.21.15.167:6789/0 conn(0x7f9744070bb0 legacy=0x7f974413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9749c13640 1 -- 172.21.15.167:0/514972253 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744071df0 con 0x7f9744070ff0 2024-09-13T17:24:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f973bfff640 1 -- 172.21.15.167:0/514972253 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887351197 0 0) 0x7f9744071b10 con 0x7f9744070bb0 2024-09-13T17:24:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f9749c13640 1 --2- 172.21.15.167:0/514972253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744070ff0 0x7f974414e160 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f97440679e0 tx=0x7f973c01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f0f6640fbe16be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f973bfff640 1 -- 172.21.15.167:0/514972253 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0a58d0 con 0x7f9744070ff0 2024-09-13T17:24:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f973bfff640 1 -- 172.21.15.167:0/514972253 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c0a5a30 con 0x7f9744070ff0 2024-09-13T17:24:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.974+0000 7f973bfff640 1 -- 172.21.15.167:0/514972253 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0a5dc0 con 0x7f9744070ff0 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/514972253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744070ff0 msgr2=0x7f974414e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 --2- 172.21.15.167:0/514972253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744070ff0 0x7f974414e160 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f97440679e0 tx=0x7f973c01c810 comp rx=0 tx=0).stop 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/514972253 shutdown_connections 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 --2- 172.21.15.167:0/514972253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744070ff0 0x7f974414e160 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 --2- 172.21.15.167:0/514972253 >> v2:172.21.15.190:3300/0 conn(0x7f974406f0f0 0x7f97440b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/514972253 >> 172.21.15.167:0/514972253 conn(0x7f97440b7250 msgr2=0x7f97440b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/514972253 shutdown_connections 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/514972253 wait complete. 2024-09-13T17:24:56.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 Processor -- start 2024-09-13T17:24:56.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- start start 2024-09-13T17:24:56.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974406f0f0 0x7f97441473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9744070bb0 0x7f9744144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9744070ff0 0x7f97441df050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744138150 con 0x7f974406f0f0 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744147900 con 0x7f9744070bb0 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9744147b60 con 0x7f9744070ff0 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974406f0f0 0x7f97441473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974406f0f0 0x7f97441473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44220/0 (socket says 172.21.15.167:44220) 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 -- 172.21.15.167:0/3422045151 learned_addr learned my addr 172.21.15.167:0/3422045151 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 -- 172.21.15.167:0/3422045151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9744070ff0 msgr2=0x7f97441df050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9744070ff0 0x7f97441df050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 -- 172.21.15.167:0/3422045151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9744070bb0 msgr2=0x7f9744144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9744070bb0 0x7f9744144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 -- 172.21.15.167:0/3422045151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c009a70 con 0x7f974406f0f0 2024-09-13T17:24:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9749412640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974406f0f0 0x7f97441473c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f974000d800 tx=0x7f974000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9739ffb640 1 -- 172.21.15.167:0/3422045151 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000b6c0 con 0x7f974406f0f0 2024-09-13T17:24:56.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9739ffb640 1 -- 172.21.15.167:0/3422045151 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974000b820 con 0x7f974406f0f0 2024-09-13T17:24:56.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9744148770 con 0x7f974406f0f0 2024-09-13T17:24:56.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f9739ffb640 1 -- 172.21.15.167:0/3422045151 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000bb90 con 0x7f974406f0f0 2024-09-13T17:24:56.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974414a210 con 0x7f974406f0f0 2024-09-13T17:24:56.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.978+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97440b2b90 con 0x7f974406f0f0 2024-09-13T17:24:56.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.982+0000 7f9739ffb640 1 -- 172.21.15.167:0/3422045151 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f974000bcf0 con 0x7f974406f0f0 2024-09-13T17:24:56.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.982+0000 7f9739ffb640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9728066690 0x7f9728068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.982+0000 7f9739ffb640 1 -- 172.21.15.167:0/3422045151 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9740085300 con 0x7f974406f0f0 2024-09-13T17:24:56.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.982+0000 7f9748c11640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9728066690 0x7f9728068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.982+0000 7f9748c11640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9728066690 0x7f9728068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97340011f0 tx=0x7f9734007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:56.986+0000 7f9739ffb640 1 -- 172.21.15.167:0/3422045151 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9740052400 con 0x7f974406f0f0 2024-09-13T17:24:57.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.142+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f974413dfc0 con 0x7f9728066690 2024-09-13T17:24:57.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.154+0000 7f9739ffb640 1 -- 172.21.15.167:0/3422045151 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368510 (secure 0 0 0) 0x7f97340070d0 con 0x7f9728066690 2024-09-13T17:24:57.158 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:24:57.162 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:24:57.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9728066690 msgr2=0x7f9728068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9728066690 0x7f9728068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97340011f0 tx=0x7f9734007930 comp rx=0 tx=0).stop 2024-09-13T17:24:57.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974406f0f0 msgr2=0x7f97441473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974406f0f0 0x7f97441473c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f974000d800 tx=0x7f974000dcc0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 shutdown_connections 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f9728066690 0x7f9728068b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9744070ff0 0x7f97441df050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9744070bb0 0x7f9744144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 --2- 172.21.15.167:0/3422045151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974406f0f0 0x7f97441473c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 >> 172.21.15.167:0/3422045151 conn(0x7f97440b7250 msgr2=0x7f9744143840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 shutdown_connections 2024-09-13T17:24:57.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.158+0000 7f974b676640 1 -- 172.21.15.167:0/3422045151 wait complete. 2024-09-13T17:24:57.179 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T17:24:55.575970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1408757,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":304,"num_write_kb":3290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221348,"kb_used_data":5220,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753372,"statfs":{"total":773094113280,"available":772867452928,"internally_reserved":0,"allocated":5345280,"data_stored":3814953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23093,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003919"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712812+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:21:32.712812+0000","last_peered":"2024-09-13T17:21:32.712812+0000","last_clean":"2024-09-13T17:21:32.712812+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:21:32.712812+0000","last_undegraded":"2024-09-13T17:21:32.712812+0000","last_fullsized":"2024-09-13T17:21:32.712812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.549720+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:22:53.549720+0000","last_peered":"2024-09-13T17:22:53.549720+0000","last_clean":"2024-09-13T17:22:53.549720+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:22:53.549720+0000","last_undegraded":"2024-09-13T17:22:53.549720+0000","last_fullsized":"2024-09-13T17:22:53.549720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709835+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:21:32.709835+0000","last_peered":"2024-09-13T17:21:32.709835+0000","last_clean":"2024-09-13T17:21:32.709835+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:21:32.709835+0000","last_undegraded":"2024-09-13T17:21:32.709835+0000","last_fullsized":"2024-09-13T17:21:32.709835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.549774+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:22:53.549774+0000","last_peered":"2024-09-13T17:22:53.549774+0000","last_clean":"2024-09-13T17:22:53.549774+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:22:53.549774+0000","last_undegraded":"2024-09-13T17:22:53.549774+0000","last_fullsized":"2024-09-13T17:22:53.549774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712492+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:21:32.712492+0000","last_peered":"2024-09-13T17:21:32.712492+0000","last_clean":"2024-09-13T17:21:32.712492+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:21:32.712492+0000","last_undegraded":"2024-09-13T17:21:32.712492+0000","last_fullsized":"2024-09-13T17:21:32.712492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715058+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:21:32.715058+0000","last_peered":"2024-09-13T17:21:32.715058+0000","last_clean":"2024-09-13T17:21:32.715058+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:21:32.715058+0000","last_undegraded":"2024-09-13T17:21:32.715058+0000","last_fullsized":"2024-09-13T17:21:32.715058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.030817+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:22:41.030817+0000","last_peered":"2024-09-13T17:22:41.030817+0000","last_clean":"2024-09-13T17:22:41.030817+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:22:41.030817+0000","last_undegraded":"2024-09-13T17:22:41.030817+0000","last_fullsized":"2024-09-13T17:22:41.030817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.720891+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:21:32.720891+0000","last_peered":"2024-09-13T17:21:32.720891+0000","last_clean":"2024-09-13T17:21:32.720891+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:21:32.720891+0000","last_undegraded":"2024-09-13T17:21:32.720891+0000","last_fullsized":"2024-09-13T17:21:32.720891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715545+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:21:32.715545+0000","last_peered":"2024-09-13T17:21:32.715545+0000","last_clean":"2024-09-13T17:21:32.715545+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:21:32.715545+0000","last_undegraded":"2024-09-13T17:21:32.715545+0000","last_fullsized":"2024-09-13T17:21:32.715545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.557212+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:23:23.557212+0000","last_peered":"2024-09-13T17:23:23.557212+0000","last_clean":"2024-09-13T17:23:23.557212+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:23:23.557212+0000","last_undegraded":"2024-09-13T17:23:23.557212+0000","last_fullsized":"2024-09-13T17:23:23.557212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721716+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:21:32.721716+0000","last_peered":"2024-09-13T17:21:32.721716+0000","last_clean":"2024-09-13T17:21:32.721716+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:21:32.721716+0000","last_undegraded":"2024-09-13T17:21:32.721716+0000","last_fullsized":"2024-09-13T17:21:32.721716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715495+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:21:32.715495+0000","last_peered":"2024-09-13T17:21:32.715495+0000","last_clean":"2024-09-13T17:21:32.715495+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:21:32.715495+0000","last_undegraded":"2024-09-13T17:21:32.715495+0000","last_fullsized":"2024-09-13T17:21:32.715495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373334+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:21:33.373334+0000","last_peered":"2024-09-13T17:21:33.373334+0000","last_clean":"2024-09-13T17:21:33.373334+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:21:33.373334+0000","last_undegraded":"2024-09-13T17:21:33.373334+0000","last_fullsized":"2024-09-13T17:21:33.373334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.044555+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:22:51.044555+0000","last_peered":"2024-09-13T17:22:51.044555+0000","last_clean":"2024-09-13T17:22:51.044555+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:22:51.044555+0000","last_undegraded":"2024-09-13T17:22:51.044555+0000","last_fullsized":"2024-09-13T17:22:51.044555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.716876+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:21:32.716876+0000","last_peered":"2024-09-13T17:21:32.716876+0000","last_clean":"2024-09-13T17:21:32.716876+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:21:32.716876+0000","last_undegraded":"2024-09-13T17:21:32.716876+0000","last_fullsized":"2024-09-13T17:21:32.716876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713629+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:21:32.713629+0000","last_peered":"2024-09-13T17:21:32.713629+0000","last_clean":"2024-09-13T17:21:32.713629+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:21:32.713629+0000","last_undegraded":"2024-09-13T17:21:32.713629+0000","last_fullsized":"2024-09-13T17:21:32.713629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780740+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:21:32.780740+0000","last_peered":"2024-09-13T17:21:32.780740+0000","last_clean":"2024-09-13T17:21:32.780740+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:21:32.780740+0000","last_undegraded":"2024-09-13T17:21:32.780740+0000","last_fullsized":"2024-09-13T17:21:32.780740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717428+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:21:32.717428+0000","last_peered":"2024-09-13T17:21:32.717428+0000","last_clean":"2024-09-13T17:21:32.717428+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:21:32.717428+0000","last_undegraded":"2024-09-13T17:21:32.717428+0000","last_fullsized":"2024-09-13T17:21:32.717428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710241+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:21:32.710241+0000","last_peered":"2024-09-13T17:21:32.710241+0000","last_clean":"2024-09-13T17:21:32.710241+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:21:32.710241+0000","last_undegraded":"2024-09-13T17:21:32.710241+0000","last_fullsized":"2024-09-13T17:21:32.710241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.041977+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:22:51.041977+0000","last_peered":"2024-09-13T17:22:51.041977+0000","last_clean":"2024-09-13T17:22:51.041977+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:22:51.041977+0000","last_undegraded":"2024-09-13T17:22:51.041977+0000","last_fullsized":"2024-09-13T17:22:51.041977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781403+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:21:32.781403+0000","last_peered":"2024-09-13T17:21:32.781403+0000","last_clean":"2024-09-13T17:21:32.781403+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:21:32.781403+0000","last_undegraded":"2024-09-13T17:21:32.781403+0000","last_fullsized":"2024-09-13T17:21:32.781403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715766+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:21:32.715766+0000","last_peered":"2024-09-13T17:21:32.715766+0000","last_clean":"2024-09-13T17:21:32.715766+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:21:32.715766+0000","last_undegraded":"2024-09-13T17:21:32.715766+0000","last_fullsized":"2024-09-13T17:21:32.715766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043779+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:22:51.043779+0000","last_peered":"2024-09-13T17:22:51.043779+0000","last_clean":"2024-09-13T17:22:51.043779+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:22:51.043779+0000","last_undegraded":"2024-09-13T17:22:51.043779+0000","last_fullsized":"2024-09-13T17:22:51.043779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.377950+0000","last_change":"2024-09-13T17:21:33.376826+0000","last_active":"2024-09-13T17:21:33.377950+0000","last_peered":"2024-09-13T17:21:33.377950+0000","last_clean":"2024-09-13T17:21:33.377950+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:21:33.377950+0000","last_undegraded":"2024-09-13T17:21:33.377950+0000","last_fullsized":"2024-09-13T17:21:33.377950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:39.885449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712490+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:21:32.712490+0000","last_peered":"2024-09-13T17:21:32.712490+0000","last_clean":"2024-09-13T17:21:32.712490+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:21:32.712490+0000","last_undegraded":"2024-09-13T17:21:32.712490+0000","last_fullsized":"2024-09-13T17:21:32.712490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047002+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:22:51.047002+0000","last_peered":"2024-09-13T17:22:51.047002+0000","last_clean":"2024-09-13T17:22:51.047002+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:22:51.047002+0000","last_undegraded":"2024-09-13T17:22:51.047002+0000","last_fullsized":"2024-09-13T17:22:51.047002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715303+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:21:32.715303+0000","last_peered":"2024-09-13T17:21:32.715303+0000","last_clean":"2024-09-13T17:21:32.715303+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:21:32.715303+0000","last_undegraded":"2024-09-13T17:21:32.715303+0000","last_fullsized":"2024-09-13T17:21:32.715303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715332+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:21:32.715332+0000","last_peered":"2024-09-13T17:21:32.715332+0000","last_clean":"2024-09-13T17:21:32.715332+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:21:32.715332+0000","last_undegraded":"2024-09-13T17:21:32.715332+0000","last_fullsized":"2024-09-13T17:21:32.715332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'21","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:59.882120+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:23:59.882120+0000","last_peered":"2024-09-13T17:23:59.882120+0000","last_clean":"2024-09-13T17:23:59.882120+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:23:59.882120+0000","last_undegraded":"2024-09-13T17:23:59.882120+0000","last_fullsized":"2024-09-13T17:23:59.882120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709522+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:21:32.709522+0000","last_peered":"2024-09-13T17:21:32.709522+0000","last_clean":"2024-09-13T17:21:32.709522+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:21:32.709522+0000","last_undegraded":"2024-09-13T17:21:32.709522+0000","last_fullsized":"2024-09-13T17:21:32.709522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.543105+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:22:58.543105+0000","last_peered":"2024-09-13T17:22:58.543105+0000","last_clean":"2024-09-13T17:22:58.543105+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:22:58.543105+0000","last_undegraded":"2024-09-13T17:22:58.543105+0000","last_fullsized":"2024-09-13T17:22:58.543105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.031459+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:22:41.031459+0000","last_peered":"2024-09-13T17:22:41.031459+0000","last_clean":"2024-09-13T17:22:41.031459+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:22:41.031459+0000","last_undegraded":"2024-09-13T17:22:41.031459+0000","last_fullsized":"2024-09-13T17:22:41.031459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:50.928673+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:23:50.928673+0000","last_peered":"2024-09-13T17:23:50.928673+0000","last_clean":"2024-09-13T17:23:50.928673+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:23:50.928673+0000","last_undegraded":"2024-09-13T17:23:50.928673+0000","last_fullsized":"2024-09-13T17:23:50.928673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.785217+0000","last_change":"2024-09-13T17:21:32.783988+0000","last_active":"2024-09-13T17:21:32.785217+0000","last_peered":"2024-09-13T17:21:32.785217+0000","last_clean":"2024-09-13T17:21:32.785217+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:21:32.785217+0000","last_undegraded":"2024-09-13T17:21:32.785217+0000","last_fullsized":"2024-09-13T17:21:32.785217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:39.042962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780985+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:21:32.780985+0000","last_peered":"2024-09-13T17:21:32.780985+0000","last_clean":"2024-09-13T17:21:32.780985+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:21:32.780985+0000","last_undegraded":"2024-09-13T17:21:32.780985+0000","last_fullsized":"2024-09-13T17:21:32.780985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780248+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:21:32.780248+0000","last_peered":"2024-09-13T17:21:32.780248+0000","last_clean":"2024-09-13T17:21:32.780248+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:21:32.780248+0000","last_undegraded":"2024-09-13T17:21:32.780248+0000","last_fullsized":"2024-09-13T17:21:32.780248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.550986+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:22:58.550986+0000","last_peered":"2024-09-13T17:22:58.550986+0000","last_clean":"2024-09-13T17:22:58.550986+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:22:58.550986+0000","last_undegraded":"2024-09-13T17:22:58.550986+0000","last_fullsized":"2024-09-13T17:22:58.550986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.034077+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:22:46.034077+0000","last_peered":"2024-09-13T17:22:46.034077+0000","last_clean":"2024-09-13T17:22:46.034077+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:22:46.034077+0000","last_undegraded":"2024-09-13T17:22:46.034077+0000","last_fullsized":"2024-09-13T17:22:46.034077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:50.314123+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:24:50.314123+0000","last_peered":"2024-09-13T17:24:50.314123+0000","last_clean":"2024-09-13T17:24:50.314123+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:24:50.314123+0000","last_undegraded":"2024-09-13T17:24:50.314123+0000","last_fullsized":"2024-09-13T17:24:50.314123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.541951+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:22:53.541951+0000","last_peered":"2024-09-13T17:22:53.541951+0000","last_clean":"2024-09-13T17:22:53.541951+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:22:53.541951+0000","last_undegraded":"2024-09-13T17:22:53.541951+0000","last_fullsized":"2024-09-13T17:22:53.541951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'18","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:56.078682+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:23:56.078682+0000","last_peered":"2024-09-13T17:23:56.078682+0000","last_clean":"2024-09-13T17:23:56.078682+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:23:56.078682+0000","last_undegraded":"2024-09-13T17:23:56.078682+0000","last_fullsized":"2024-09-13T17:23:56.078682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:09.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10613,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":19,"num_write":12,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781623+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:21:32.781623+0000","last_peered":"2024-09-13T17:21:32.781623+0000","last_clean":"2024-09-13T17:21:32.781623+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:21:32.781623+0000","last_undegraded":"2024-09-13T17:21:32.781623+0000","last_fullsized":"2024-09-13T17:21:32.781623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711531+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:21:32.711531+0000","last_peered":"2024-09-13T17:21:32.711531+0000","last_clean":"2024-09-13T17:21:32.711531+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:21:32.711531+0000","last_undegraded":"2024-09-13T17:21:32.711531+0000","last_fullsized":"2024-09-13T17:21:32.711531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.550732+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:22:53.550732+0000","last_peered":"2024-09-13T17:22:53.550732+0000","last_clean":"2024-09-13T17:22:53.550732+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:22:53.550732+0000","last_undegraded":"2024-09-13T17:22:53.550732+0000","last_fullsized":"2024-09-13T17:22:53.550732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.206492+0000","last_change":"2024-09-13T17:21:33.205535+0000","last_active":"2024-09-13T17:21:33.206492+0000","last_peered":"2024-09-13T17:21:33.206492+0000","last_clean":"2024-09-13T17:21:33.206492+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:21:33.206492+0000","last_undegraded":"2024-09-13T17:21:33.206492+0000","last_fullsized":"2024-09-13T17:21:33.206492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:01.951295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.790078+0000","last_change":"2024-09-13T17:21:32.786124+0000","last_active":"2024-09-13T17:21:32.790078+0000","last_peered":"2024-09-13T17:21:32.790078+0000","last_clean":"2024-09-13T17:21:32.790078+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:21:32.790078+0000","last_undegraded":"2024-09-13T17:21:32.790078+0000","last_fullsized":"2024-09-13T17:21:32.790078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:04.040678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043912+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:22:51.043912+0000","last_peered":"2024-09-13T17:22:51.043912+0000","last_clean":"2024-09-13T17:22:51.043912+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:22:51.043912+0000","last_undegraded":"2024-09-13T17:22:51.043912+0000","last_fullsized":"2024-09-13T17:22:51.043912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:43.548854+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:22:43.548854+0000","last_peered":"2024-09-13T17:22:43.548854+0000","last_clean":"2024-09-13T17:22:43.548854+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:22:43.548854+0000","last_undegraded":"2024-09-13T17:22:43.548854+0000","last_fullsized":"2024-09-13T17:22:43.548854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373613+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:21:33.373613+0000","last_peered":"2024-09-13T17:21:33.373613+0000","last_clean":"2024-09-13T17:21:33.373613+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:21:33.373613+0000","last_undegraded":"2024-09-13T17:21:33.373613+0000","last_fullsized":"2024-09-13T17:21:33.373613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201783+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:21:33.201783+0000","last_peered":"2024-09-13T17:21:33.201783+0000","last_clean":"2024-09-13T17:21:33.201783+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:21:33.201783+0000","last_undegraded":"2024-09-13T17:21:33.201783+0000","last_fullsized":"2024-09-13T17:21:33.201783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043713+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:22:51.043713+0000","last_peered":"2024-09-13T17:22:51.043713+0000","last_clean":"2024-09-13T17:22:51.043713+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:22:51.043713+0000","last_undegraded":"2024-09-13T17:22:51.043713+0000","last_fullsized":"2024-09-13T17:22:51.043713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.958818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373267+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:21:33.373267+0000","last_peered":"2024-09-13T17:21:33.373267+0000","last_clean":"2024-09-13T17:21:33.373267+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:21:33.373267+0000","last_undegraded":"2024-09-13T17:21:33.373267+0000","last_fullsized":"2024-09-13T17:21:33.373267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721076+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:21:32.721076+0000","last_peered":"2024-09-13T17:21:32.721076+0000","last_clean":"2024-09-13T17:21:32.721076+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:21:32.721076+0000","last_undegraded":"2024-09-13T17:21:32.721076+0000","last_fullsized":"2024-09-13T17:21:32.721076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.042941+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:22:51.042941+0000","last_peered":"2024-09-13T17:22:51.042941+0000","last_clean":"2024-09-13T17:22:51.042941+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:22:51.042941+0000","last_undegraded":"2024-09-13T17:22:51.042941+0000","last_fullsized":"2024-09-13T17:22:51.042941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712372+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:21:32.712372+0000","last_peered":"2024-09-13T17:21:32.712372+0000","last_clean":"2024-09-13T17:21:32.712372+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:21:32.712372+0000","last_undegraded":"2024-09-13T17:21:32.712372+0000","last_fullsized":"2024-09-13T17:21:32.712372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.202208+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:21:33.202208+0000","last_peered":"2024-09-13T17:21:33.202208+0000","last_clean":"2024-09-13T17:21:33.202208+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:21:33.202208+0000","last_undegraded":"2024-09-13T17:21:33.202208+0000","last_fullsized":"2024-09-13T17:21:33.202208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.045308+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:22:51.045308+0000","last_peered":"2024-09-13T17:22:51.045308+0000","last_clean":"2024-09-13T17:22:51.045308+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:22:51.045308+0000","last_undegraded":"2024-09-13T17:22:51.045308+0000","last_fullsized":"2024-09-13T17:22:51.045308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:33.533450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717513+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:21:32.717513+0000","last_peered":"2024-09-13T17:21:32.717513+0000","last_clean":"2024-09-13T17:21:32.717513+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:21:32.717513+0000","last_undegraded":"2024-09-13T17:21:32.717513+0000","last_fullsized":"2024-09-13T17:21:32.717513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519587+0000","last_change":"2024-09-13T17:21:32.725077+0000","last_active":"2024-09-13T17:21:36.519587+0000","last_peered":"2024-09-13T17:21:36.519587+0000","last_clean":"2024-09-13T17:21:36.519587+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:21:36.519587+0000","last_undegraded":"2024-09-13T17:21:36.519587+0000","last_fullsized":"2024-09-13T17:21:36.519587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:17.569869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043971+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:22:51.043971+0000","last_peered":"2024-09-13T17:22:51.043971+0000","last_clean":"2024-09-13T17:22:51.043971+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:22:51.043971+0000","last_undegraded":"2024-09-13T17:22:51.043971+0000","last_fullsized":"2024-09-13T17:22:51.043971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715050+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:21:32.715050+0000","last_peered":"2024-09-13T17:21:32.715050+0000","last_clean":"2024-09-13T17:21:32.715050+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:21:32.715050+0000","last_undegraded":"2024-09-13T17:21:32.715050+0000","last_fullsized":"2024-09-13T17:21:32.715050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201878+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:21:33.201878+0000","last_peered":"2024-09-13T17:21:33.201878+0000","last_clean":"2024-09-13T17:21:33.201878+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:21:33.201878+0000","last_undegraded":"2024-09-13T17:21:33.201878+0000","last_fullsized":"2024-09-13T17:21:33.201878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.042768+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:22:51.042768+0000","last_peered":"2024-09-13T17:22:51.042768+0000","last_clean":"2024-09-13T17:22:51.042768+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:22:51.042768+0000","last_undegraded":"2024-09-13T17:22:51.042768+0000","last_fullsized":"2024-09-13T17:22:51.042768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:25.139372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711905+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:21:32.711905+0000","last_peered":"2024-09-13T17:21:32.711905+0000","last_clean":"2024-09-13T17:21:32.711905+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:21:32.711905+0000","last_undegraded":"2024-09-13T17:21:32.711905+0000","last_fullsized":"2024-09-13T17:21:32.711905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373494+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:21:33.373494+0000","last_peered":"2024-09-13T17:21:33.373494+0000","last_clean":"2024-09-13T17:21:33.373494+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:21:33.373494+0000","last_undegraded":"2024-09-13T17:21:33.373494+0000","last_fullsized":"2024-09-13T17:21:33.373494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047765+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:22:51.047765+0000","last_peered":"2024-09-13T17:22:51.047765+0000","last_clean":"2024-09-13T17:22:51.047765+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:22:51.047765+0000","last_undegraded":"2024-09-13T17:22:51.047765+0000","last_fullsized":"2024-09-13T17:22:51.047765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715067+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:21:32.715067+0000","last_peered":"2024-09-13T17:21:32.715067+0000","last_clean":"2024-09-13T17:21:32.715067+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:21:32.715067+0000","last_undegraded":"2024-09-13T17:21:32.715067+0000","last_fullsized":"2024-09-13T17:21:32.715067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201601+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:21:33.201601+0000","last_peered":"2024-09-13T17:21:33.201601+0000","last_clean":"2024-09-13T17:21:33.201601+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:21:33.201601+0000","last_undegraded":"2024-09-13T17:21:33.201601+0000","last_fullsized":"2024-09-13T17:21:33.201601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046511+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:22:51.046511+0000","last_peered":"2024-09-13T17:22:51.046511+0000","last_clean":"2024-09-13T17:22:51.046511+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:22:51.046511+0000","last_undegraded":"2024-09-13T17:22:51.046511+0000","last_fullsized":"2024-09-13T17:22:51.046511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713774+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:21:32.713774+0000","last_peered":"2024-09-13T17:21:32.713774+0000","last_clean":"2024-09-13T17:21:32.713774+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:21:32.713774+0000","last_undegraded":"2024-09-13T17:21:32.713774+0000","last_fullsized":"2024-09-13T17:21:32.713774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712593+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:21:32.712593+0000","last_peered":"2024-09-13T17:21:32.712593+0000","last_clean":"2024-09-13T17:21:32.712593+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:21:32.712593+0000","last_undegraded":"2024-09-13T17:21:32.712593+0000","last_fullsized":"2024-09-13T17:21:32.712593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.028553+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:22:41.028553+0000","last_peered":"2024-09-13T17:22:41.028553+0000","last_clean":"2024-09-13T17:22:41.028553+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:22:41.028553+0000","last_undegraded":"2024-09-13T17:22:41.028553+0000","last_fullsized":"2024-09-13T17:22:41.028553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721562+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:21:32.721562+0000","last_peered":"2024-09-13T17:21:32.721562+0000","last_clean":"2024-09-13T17:21:32.721562+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:21:32.721562+0000","last_undegraded":"2024-09-13T17:21:32.721562+0000","last_fullsized":"2024-09-13T17:21:32.721562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201631+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:21:33.201631+0000","last_peered":"2024-09-13T17:21:33.201631+0000","last_clean":"2024-09-13T17:21:33.201631+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:21:33.201631+0000","last_undegraded":"2024-09-13T17:21:33.201631+0000","last_fullsized":"2024-09-13T17:21:33.201631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'57","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:50.418915+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:24:50.418915+0000","last_peered":"2024-09-13T17:24:50.418915+0000","last_clean":"2024-09-13T17:24:50.418915+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:24:50.418915+0000","last_undegraded":"2024-09-13T17:24:50.418915+0000","last_fullsized":"2024-09-13T17:24:50.418915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":806978,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780411+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:21:32.780411+0000","last_peered":"2024-09-13T17:21:32.780411+0000","last_clean":"2024-09-13T17:21:32.780411+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:21:32.780411+0000","last_undegraded":"2024-09-13T17:21:32.780411+0000","last_fullsized":"2024-09-13T17:21:32.780411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717981+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:21:32.717981+0000","last_peered":"2024-09-13T17:21:32.717981+0000","last_clean":"2024-09-13T17:21:32.717981+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:21:32.717981+0000","last_undegraded":"2024-09-13T17:21:32.717981+0000","last_fullsized":"2024-09-13T17:21:32.717981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'14","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:52.126340+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:24:52.126340+0000","last_peered":"2024-09-13T17:24:52.126340+0000","last_clean":"2024-09-13T17:24:52.126340+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:24:52.126340+0000","last_undegraded":"2024-09-13T17:24:52.126340+0000","last_fullsized":"2024-09-13T17:24:52.126340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715770+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:21:32.715770+0000","last_peered":"2024-09-13T17:21:32.715770+0000","last_clean":"2024-09-13T17:21:32.715770+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:21:32.715770+0000","last_undegraded":"2024-09-13T17:21:32.715770+0000","last_fullsized":"2024-09-13T17:21:32.715770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519675+0000","last_change":"2024-09-13T17:21:32.722613+0000","last_active":"2024-09-13T17:21:36.519675+0000","last_peered":"2024-09-13T17:21:36.519675+0000","last_clean":"2024-09-13T17:21:36.519675+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:21:36.519675+0000","last_undegraded":"2024-09-13T17:21:36.519675+0000","last_fullsized":"2024-09-13T17:21:36.519675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:48.677916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047585+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:22:51.047585+0000","last_peered":"2024-09-13T17:22:51.047585+0000","last_clean":"2024-09-13T17:22:51.047585+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:22:51.047585+0000","last_undegraded":"2024-09-13T17:22:51.047585+0000","last_fullsized":"2024-09-13T17:22:51.047585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709825+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:21:32.709825+0000","last_peered":"2024-09-13T17:21:32.709825+0000","last_clean":"2024-09-13T17:21:32.709825+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:21:32.709825+0000","last_undegraded":"2024-09-13T17:21:32.709825+0000","last_fullsized":"2024-09-13T17:21:32.709825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721834+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:21:32.721834+0000","last_peered":"2024-09-13T17:21:32.721834+0000","last_clean":"2024-09-13T17:21:32.721834+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:21:32.721834+0000","last_undegraded":"2024-09-13T17:21:32.721834+0000","last_fullsized":"2024-09-13T17:21:32.721834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046749+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:22:51.046749+0000","last_peered":"2024-09-13T17:22:51.046749+0000","last_clean":"2024-09-13T17:22:51.046749+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:22:51.046749+0000","last_undegraded":"2024-09-13T17:22:51.046749+0000","last_fullsized":"2024-09-13T17:22:51.046749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710043+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:21:32.710043+0000","last_peered":"2024-09-13T17:21:32.710043+0000","last_clean":"2024-09-13T17:21:32.710043+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:21:32.710043+0000","last_undegraded":"2024-09-13T17:21:32.710043+0000","last_fullsized":"2024-09-13T17:21:32.710043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711841+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:21:32.711841+0000","last_peered":"2024-09-13T17:21:32.711841+0000","last_clean":"2024-09-13T17:21:32.711841+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:21:32.711841+0000","last_undegraded":"2024-09-13T17:21:32.711841+0000","last_fullsized":"2024-09-13T17:21:32.711841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.779844+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:21:32.779844+0000","last_peered":"2024-09-13T17:21:32.779844+0000","last_clean":"2024-09-13T17:21:32.779844+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:21:32.779844+0000","last_undegraded":"2024-09-13T17:21:32.779844+0000","last_fullsized":"2024-09-13T17:21:32.779844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046252+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:22:51.046252+0000","last_peered":"2024-09-13T17:22:51.046252+0000","last_clean":"2024-09-13T17:22:51.046252+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:22:51.046252+0000","last_undegraded":"2024-09-13T17:22:51.046252+0000","last_fullsized":"2024-09-13T17:22:51.046252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374293+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:21:33.374293+0000","last_peered":"2024-09-13T17:21:33.374293+0000","last_clean":"2024-09-13T17:21:33.374293+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:21:33.374293+0000","last_undegraded":"2024-09-13T17:21:33.374293+0000","last_fullsized":"2024-09-13T17:21:33.374293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710039+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:21:32.710039+0000","last_peered":"2024-09-13T17:21:32.710039+0000","last_clean":"2024-09-13T17:21:32.710039+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:21:32.710039+0000","last_undegraded":"2024-09-13T17:21:32.710039+0000","last_fullsized":"2024-09-13T17:21:32.710039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046569+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:22:51.046569+0000","last_peered":"2024-09-13T17:22:51.046569+0000","last_clean":"2024-09-13T17:22:51.046569+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:22:51.046569+0000","last_undegraded":"2024-09-13T17:22:51.046569+0000","last_fullsized":"2024-09-13T17:22:51.046569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.032396+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:22:46.032396+0000","last_peered":"2024-09-13T17:22:46.032396+0000","last_clean":"2024-09-13T17:22:46.032396+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:22:46.032396+0000","last_undegraded":"2024-09-13T17:22:46.032396+0000","last_fullsized":"2024-09-13T17:22:46.032396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712613+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:21:32.712613+0000","last_peered":"2024-09-13T17:21:32.712613+0000","last_clean":"2024-09-13T17:21:32.712613+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:21:32.712613+0000","last_undegraded":"2024-09-13T17:21:32.712613+0000","last_fullsized":"2024-09-13T17:21:32.712613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717613+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:21:32.717613+0000","last_peered":"2024-09-13T17:21:32.717613+0000","last_clean":"2024-09-13T17:21:32.717613+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:21:32.717613+0000","last_undegraded":"2024-09-13T17:21:32.717613+0000","last_fullsized":"2024-09-13T17:21:32.717613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:31.608726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.027160+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:22:41.027160+0000","last_peered":"2024-09-13T17:22:41.027160+0000","last_clean":"2024-09-13T17:22:41.027160+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:22:41.027160+0000","last_undegraded":"2024-09-13T17:22:41.027160+0000","last_fullsized":"2024-09-13T17:22:41.027160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715927+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:21:32.715927+0000","last_peered":"2024-09-13T17:21:32.715927+0000","last_clean":"2024-09-13T17:21:32.715927+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:21:32.715927+0000","last_undegraded":"2024-09-13T17:21:32.715927+0000","last_fullsized":"2024-09-13T17:21:32.715927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.726286+0000","last_change":"2024-09-13T17:21:32.724190+0000","last_active":"2024-09-13T17:21:32.726286+0000","last_peered":"2024-09-13T17:21:32.726286+0000","last_clean":"2024-09-13T17:21:32.726286+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:21:32.726286+0000","last_undegraded":"2024-09-13T17:21:32.726286+0000","last_fullsized":"2024-09-13T17:21:32.726286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:48.005131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373229+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:21:33.373229+0000","last_peered":"2024-09-13T17:21:33.373229+0000","last_clean":"2024-09-13T17:21:33.373229+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:21:33.373229+0000","last_undegraded":"2024-09-13T17:21:33.373229+0000","last_fullsized":"2024-09-13T17:21:33.373229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717837+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:21:32.717837+0000","last_peered":"2024-09-13T17:21:32.717837+0000","last_clean":"2024-09-13T17:21:32.717837+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:21:32.717837+0000","last_undegraded":"2024-09-13T17:21:32.717837+0000","last_fullsized":"2024-09-13T17:21:32.717837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:44.697368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.719820+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:21:32.719820+0000","last_peered":"2024-09-13T17:21:32.719820+0000","last_clean":"2024-09-13T17:21:32.719820+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:21:32.719820+0000","last_undegraded":"2024-09-13T17:21:32.719820+0000","last_fullsized":"2024-09-13T17:21:32.719820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712462+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:21:32.712462+0000","last_peered":"2024-09-13T17:21:32.712462+0000","last_clean":"2024-09-13T17:21:32.712462+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:21:32.712462+0000","last_undegraded":"2024-09-13T17:21:32.712462+0000","last_fullsized":"2024-09-13T17:21:32.712462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.714328+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:21:32.714328+0000","last_peered":"2024-09-13T17:21:32.714328+0000","last_clean":"2024-09-13T17:21:32.714328+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:21:32.714328+0000","last_undegraded":"2024-09-13T17:21:32.714328+0000","last_fullsized":"2024-09-13T17:21:32.714328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780794+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:21:32.780794+0000","last_peered":"2024-09-13T17:21:32.780794+0000","last_clean":"2024-09-13T17:21:32.780794+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:21:32.780794+0000","last_undegraded":"2024-09-13T17:21:32.780794+0000","last_fullsized":"2024-09-13T17:21:32.780794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374611+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:21:33.374611+0000","last_peered":"2024-09-13T17:21:33.374611+0000","last_clean":"2024-09-13T17:21:33.374611+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:21:33.374611+0000","last_undegraded":"2024-09-13T17:21:33.374611+0000","last_fullsized":"2024-09-13T17:21:33.374611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715221+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:21:32.715221+0000","last_peered":"2024-09-13T17:21:32.715221+0000","last_clean":"2024-09-13T17:21:32.715221+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:21:32.715221+0000","last_undegraded":"2024-09-13T17:21:32.715221+0000","last_fullsized":"2024-09-13T17:21:32.715221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.718384+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:21:32.718384+0000","last_peered":"2024-09-13T17:21:32.718384+0000","last_clean":"2024-09-13T17:21:32.718384+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:21:32.718384+0000","last_undegraded":"2024-09-13T17:21:32.718384+0000","last_fullsized":"2024-09-13T17:21:32.718384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710471+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:21:32.710471+0000","last_peered":"2024-09-13T17:21:32.710471+0000","last_clean":"2024-09-13T17:21:32.710471+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:21:32.710471+0000","last_undegraded":"2024-09-13T17:21:32.710471+0000","last_fullsized":"2024-09-13T17:21:32.710471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.719661+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:21:32.719661+0000","last_peered":"2024-09-13T17:21:32.719661+0000","last_clean":"2024-09-13T17:21:32.719661+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:21:32.719661+0000","last_undegraded":"2024-09-13T17:21:32.719661+0000","last_fullsized":"2024-09-13T17:21:32.719661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712107+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:21:32.712107+0000","last_peered":"2024-09-13T17:21:32.712107+0000","last_clean":"2024-09-13T17:21:32.712107+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:21:32.712107+0000","last_undegraded":"2024-09-13T17:21:32.712107+0000","last_fullsized":"2024-09-13T17:21:32.712107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374030+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:21:33.374030+0000","last_peered":"2024-09-13T17:21:33.374030+0000","last_clean":"2024-09-13T17:21:33.374030+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:21:33.374030+0000","last_undegraded":"2024-09-13T17:21:33.374030+0000","last_fullsized":"2024-09-13T17:21:33.374030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.202223+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:21:33.202223+0000","last_peered":"2024-09-13T17:21:33.202223+0000","last_clean":"2024-09-13T17:21:33.202223+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:21:33.202223+0000","last_undegraded":"2024-09-13T17:21:33.202223+0000","last_fullsized":"2024-09-13T17:21:33.202223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.720422+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:21:32.720422+0000","last_peered":"2024-09-13T17:21:32.720422+0000","last_clean":"2024-09-13T17:21:32.720422+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:21:32.720422+0000","last_undegraded":"2024-09-13T17:21:32.720422+0000","last_fullsized":"2024-09-13T17:21:32.720422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:03.506249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.722233+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:21:32.722233+0000","last_peered":"2024-09-13T17:21:32.722233+0000","last_clean":"2024-09-13T17:21:32.722233+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:21:32.722233+0000","last_undegraded":"2024-09-13T17:21:32.722233+0000","last_fullsized":"2024-09-13T17:21:32.722233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.718784+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:21:32.718784+0000","last_peered":"2024-09-13T17:21:32.718784+0000","last_clean":"2024-09-13T17:21:32.718784+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:21:32.718784+0000","last_undegraded":"2024-09-13T17:21:32.718784+0000","last_fullsized":"2024-09-13T17:21:32.718784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.779951+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:21:32.779951+0000","last_peered":"2024-09-13T17:21:32.779951+0000","last_clean":"2024-09-13T17:21:32.779951+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:21:32.779951+0000","last_undegraded":"2024-09-13T17:21:32.779951+0000","last_fullsized":"2024-09-13T17:21:32.779951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712325+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:21:32.712325+0000","last_peered":"2024-09-13T17:21:32.712325+0000","last_clean":"2024-09-13T17:21:32.712325+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:21:32.712325+0000","last_undegraded":"2024-09-13T17:21:32.712325+0000","last_fullsized":"2024-09-13T17:21:32.712325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713394+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:21:32.713394+0000","last_peered":"2024-09-13T17:21:32.713394+0000","last_clean":"2024-09-13T17:21:32.713394+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:21:32.713394+0000","last_undegraded":"2024-09-13T17:21:32.713394+0000","last_fullsized":"2024-09-13T17:21:32.713394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717783+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:21:32.717783+0000","last_peered":"2024-09-13T17:21:32.717783+0000","last_clean":"2024-09-13T17:21:32.717783+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:21:32.717783+0000","last_undegraded":"2024-09-13T17:21:32.717783+0000","last_fullsized":"2024-09-13T17:21:32.717783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374235+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:21:33.374235+0000","last_peered":"2024-09-13T17:21:33.374235+0000","last_clean":"2024-09-13T17:21:33.374235+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:21:33.374235+0000","last_undegraded":"2024-09-13T17:21:33.374235+0000","last_fullsized":"2024-09-13T17:21:33.374235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374509+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:21:33.374509+0000","last_peered":"2024-09-13T17:21:33.374509+0000","last_clean":"2024-09-13T17:21:33.374509+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:21:33.374509+0000","last_undegraded":"2024-09-13T17:21:33.374509+0000","last_fullsized":"2024-09-13T17:21:33.374509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201762+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:21:33.201762+0000","last_peered":"2024-09-13T17:21:33.201762+0000","last_clean":"2024-09-13T17:21:33.201762+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:21:33.201762+0000","last_undegraded":"2024-09-13T17:21:33.201762+0000","last_fullsized":"2024-09-13T17:21:33.201762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709799+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:21:32.709799+0000","last_peered":"2024-09-13T17:21:32.709799+0000","last_clean":"2024-09-13T17:21:32.709799+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:21:32.709799+0000","last_undegraded":"2024-09-13T17:21:32.709799+0000","last_fullsized":"2024-09-13T17:21:32.709799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201226+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:21:33.201226+0000","last_peered":"2024-09-13T17:21:33.201226+0000","last_clean":"2024-09-13T17:21:33.201226+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:21:33.201226+0000","last_undegraded":"2024-09-13T17:21:33.201226+0000","last_fullsized":"2024-09-13T17:21:33.201226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:36.519499+0000","last_change":"2024-09-13T17:21:32.721986+0000","last_active":"2024-09-13T17:21:36.519499+0000","last_peered":"2024-09-13T17:21:36.519499+0000","last_clean":"2024-09-13T17:21:36.519499+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:21:36.519499+0000","last_undegraded":"2024-09-13T17:21:36.519499+0000","last_fullsized":"2024-09-13T17:21:36.519499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:04.661478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201356+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:21:33.201356+0000","last_peered":"2024-09-13T17:21:33.201356+0000","last_clean":"2024-09-13T17:21:33.201356+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:21:33.201356+0000","last_undegraded":"2024-09-13T17:21:33.201356+0000","last_fullsized":"2024-09-13T17:21:33.201356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.556068+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:22:53.556068+0000","last_peered":"2024-09-13T17:22:53.556068+0000","last_clean":"2024-09-13T17:22:53.556068+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:22:53.556068+0000","last_undegraded":"2024-09-13T17:22:53.556068+0000","last_fullsized":"2024-09-13T17:22:53.556068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712194+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:21:32.712194+0000","last_peered":"2024-09-13T17:21:32.712194+0000","last_clean":"2024-09-13T17:21:32.712194+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:21:32.712194+0000","last_undegraded":"2024-09-13T17:21:32.712194+0000","last_fullsized":"2024-09-13T17:21:32.712194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781454+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:21:32.781454+0000","last_peered":"2024-09-13T17:21:32.781454+0000","last_clean":"2024-09-13T17:21:32.781454+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:21:32.781454+0000","last_undegraded":"2024-09-13T17:21:32.781454+0000","last_fullsized":"2024-09-13T17:21:32.781454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.201533+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:21:33.201533+0000","last_peered":"2024-09-13T17:21:33.201533+0000","last_clean":"2024-09-13T17:21:33.201533+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:21:33.201533+0000","last_undegraded":"2024-09-13T17:21:33.201533+0000","last_fullsized":"2024-09-13T17:21:33.201533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":818389,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":19,"num_write":139,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1695744,"data_stored":1637089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.86799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.081,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2150000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.92800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0660000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.04},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1379999999999999,"5min":1.216,"15min":1.216},"last":1.218}]},{"osd":2,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.29},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.84099999999999997},"min":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.526,"15min":1.526},"last":1.0589999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.91000000000000003,"15min":0.93799999999999994},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.165,"5min":1.23,"15min":1.23},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96699999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.109,"5min":1.365,"15min":1.365},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.109},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.167,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1859999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0720000000000001,"15min":1.1200000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.218,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.139},{"interface":"front","average":{"1min":1.046,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.88900000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2549999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.085}]}]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1122304,"data_stored":931107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.501,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1140000000000001,"5min":1.167,"15min":1.167},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.84199999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1379999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0720000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0880000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.997}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.875,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.181,"5min":1.615,"15min":1.615},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.268,"15min":1.268},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":2.149,"15min":2.149},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98999999999999999,"15min":1.018},"min":{"1min":0.70099999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1200000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.153}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.218,"5min":1.367,"15min":1.367},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0429999999999999,"15min":1.0669999999999999},"min":{"1min":0.68500000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.21,"5min":2.069,"15min":2.069},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.077},"min":{"1min":0.76300000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2150000000000001,"5min":1.964,"15min":1.964},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.997,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.73299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.619,"15min":1.619},"last":1.034}]}]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.232,"15min":1.232},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.84999999999999998},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.84599999999999997,"15min":0.86399999999999999},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.71999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.466,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97299999999999998,"15min":0.997},"min":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.276,"5min":1.339,"15min":1.339},"last":0.745}]},{"osd":4,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.97399999999999998,"15min":0.94999999999999996},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.075,"15min":1.1040000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":1.339,"15min":1.339},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.84299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.129,"15min":1.159},"min":{"1min":0.872,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0640000000000001,"15min":1.0940000000000001},"min":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83299999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.111,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.872},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.873,"15min":0.92700000000000005},"min":{"1min":0.505,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0049999999999999,"5min":1.611,"15min":1.611},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78800000000000003,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.879},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.1120000000000001,"5min":1.23,"15min":1.23},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90200000000000002,"15min":0.96899999999999997},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1020000000000001,"5min":1.754,"15min":1.754},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1990000000000001,"5min":1.268,"15min":1.268},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.92300000000000004,"15min":0.98299999999999998},"min":{"1min":0.68000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.78,"15min":1.78},"last":1.0089999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0960000000000001,"5min":1.694,"15min":1.694},"last":1.161},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.032,"15min":1.0840000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1399999999999999,"5min":1.907,"15min":1.907},"last":0.98599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.97899999999999998,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1299999999999999,"5min":1.53,"15min":1.53},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0509999999999999,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1539999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.0960000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.1220000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.137,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.089,"15min":1.147},"min":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1970000000000001,"5min":1.863,"15min":1.863},"last":1.0609999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1134592,"data_stored":942031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.78000000000000003,"5min":1.014,"15min":1.014},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.054,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.38}]},{"osd":1,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.66200000000000003},"min":{"1min":0.32000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.34599999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.93999999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.70499999999999996},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1060000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.71499999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.022,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.02,"5min":1.51,"15min":1.51},"last":1.024},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3300000000000001,"5min":1.421,"15min":1.421},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.61499999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1020000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96799999999999997,"15min":1.01},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.397,"5min":1.712,"15min":1.712},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3280000000000001,"5min":1.756,"15min":1.756},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94799999999999995,"15min":1.004},"min":{"1min":0.59499999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.248,"5min":1.946,"15min":1.946},"last":0.93899999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.61599999999999999},"min":{"1min":0.26000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.62,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.85199999999999998,"5min":1.466,"15min":1.466},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59399999999999997,"15min":0.622},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95199999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.29699999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.94099999999999995,"5min":1.419,"15min":1.419},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.72199999999999998},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91600000000000004,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.625,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.878,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1020000000000001,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91300000000000003,"15min":0.96699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2529999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":0.97999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2669999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3580000000000001,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95299999999999996,"15min":1.026},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3049999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":1.02},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.65000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3400000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.88700000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57599999999999996,"15min":0.626},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63800000000000001,"15min":0.66700000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.873,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89400000000000002,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":1.214,"5min":1.401,"15min":1.401},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.877},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.752},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.88700000000000001},"min":{"1min":0.57499999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.266,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88800000000000001,"15min":0.93899999999999995},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2709999999999999,"5min":1.365,"15min":1.365},"last":0.80800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86499999999999999,"15min":0.91700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1870000000000001,"5min":1.323,"15min":1.323},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.995},"min":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.23,"5min":1.639,"15min":1.639},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92600000000000005,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.528,"15min":1.528},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":138838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.58899999999999997},"min":{"1min":0.28399999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.60499999999999998},"min":{"1min":0.308,"5min":0.255,"15min":0.255},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83499999999999996,"5min":1.075,"15min":1.075},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.66200000000000003},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.749}]},{"osd":3,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60799999999999998,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.88400000000000001,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.72999999999999998},"min":{"1min":0.36199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.88200000000000001},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.153,"5min":1.351,"15min":1.351},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0109999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.878,"15min":0.93799999999999994},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.056,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1799999999999999,"5min":1.21,"15min":1.21},"last":0.82599999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.92200000000000004},"min":{"1min":0.56799999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1359999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.425,"15min":1.425},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.127,"5min":1.554,"15min":1.554},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92100000000000004,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1040000000000001,"5min":1.454,"15min":1.454},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":817902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":815104,"data_stored":806978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:24:57.185 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.338+0000 7fa17fe9e640 1 Processor -- start 2024-09-13T17:24:57.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.338+0000 7fa17fe9e640 1 -- start start 2024-09-13T17:24:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17fe9e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1780b2240 0x7fa1780b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17fe9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1781526b0 0x7fa178154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17fe9e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17814a200 con 0x7fa1780ada90 2024-09-13T17:24:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17fe9e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17814ada0 con 0x7fa1780b2240 2024-09-13T17:24:57.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17fe9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780ae230 con 0x7fa1781526b0 2024-09-13T17:24:57.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1780b2240 0x7fa1780b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17e43b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1781526b0 0x7fa178154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1780b2240 0x7fa1780b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:43026/0 (socket says 172.21.15.167:43026) 2024-09-13T17:24:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 -- 172.21.15.167:0/3711754783 learned_addr learned my addr 172.21.15.167:0/3711754783 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 -- 172.21.15.167:0/3711754783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1781526b0 msgr2=0x7fa178154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 --2- 172.21.15.167:0/3711754783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1781526b0 0x7fa178154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 -- 172.21.15.167:0/3711754783 >> v1:172.21.15.190:6789/0 conn(0x7fa1780ada90 legacy=0x7fa17814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 -- 172.21.15.167:0/3711754783 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17809d450 con 0x7fa1780b2240 2024-09-13T17:24:57.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.342+0000 7fa17d439640 1 --2- 172.21.15.167:0/3711754783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1780b2240 0x7fa1780b2660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa168009870 tx=0x7fa16801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a291138f3ba787 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:57.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17cc38640 1 -- 172.21.15.167:0/3711754783 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680ab5f0 con 0x7fa1780b2240 2024-09-13T17:24:57.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17cc38640 1 -- 172.21.15.167:0/3711754783 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1680ab750 con 0x7fa1780b2240 2024-09-13T17:24:57.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17cc38640 1 -- 172.21.15.167:0/3711754783 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680abae0 con 0x7fa1780b2240 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3711754783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1780b2240 msgr2=0x7fa1780b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3711754783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1780b2240 0x7fa1780b2660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa168009870 tx=0x7fa16801c560 comp rx=0 tx=0).stop 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3711754783 shutdown_connections 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3711754783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1781526b0 0x7fa178154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3711754783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1780b2240 0x7fa1780b2660 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3711754783 >> 172.21.15.167:0/3711754783 conn(0x7fa1780b3c30 msgr2=0x7fa1780b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3711754783 shutdown_connections 2024-09-13T17:24:57.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3711754783 wait complete. 2024-09-13T17:24:57.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 Processor -- start 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- start start 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1780ada90 0x7fa178070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1780b2240 0x7fa17806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1781526b0 0x7fa17806e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17809c7d0 con 0x7fa1780ada90 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178070440 con 0x7fa1781526b0 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17809ca90 con 0x7fa1780b2240 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1780ada90 0x7fa178070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1780ada90 0x7fa178070ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58120/0 (socket says 172.21.15.167:58120) 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 -- 172.21.15.167:0/3544221572 learned_addr learned my addr 172.21.15.167:0/3544221572 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:57.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17d439640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1780b2240 0x7fa17806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17e43b640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1781526b0 0x7fa17806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 -- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1780b2240 msgr2=0x7fa17806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1780b2240 0x7fa17806f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 -- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1781526b0 msgr2=0x7fa17806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1781526b0 0x7fa17806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 -- 172.21.15.167:0/3544221572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680094d0 con 0x7fa1780ada90 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17d439640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1780b2240 0x7fa17806f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17e43b640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1781526b0 0x7fa17806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17dc3a640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1780ada90 0x7fa178070ea0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c370 tx=0x7fa17400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa16e7fc640 1 -- 172.21.15.167:0/3544221572 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1740052d0 con 0x7fa1780ada90 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa16e7fc640 1 -- 172.21.15.167:0/3544221572 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa174005430 con 0x7fa1780ada90 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17809cd70 con 0x7fa1780ada90 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa16e7fc640 1 -- 172.21.15.167:0/3544221572 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174007260 con 0x7fa1780ada90 2024-09-13T17:24:57.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.346+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17806fee0 con 0x7fa1780ada90 2024-09-13T17:24:57.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.350+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17809d220 con 0x7fa1780ada90 2024-09-13T17:24:57.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.350+0000 7fa16e7fc640 1 -- 172.21.15.167:0/3544221572 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1740073c0 con 0x7fa1780ada90 2024-09-13T17:24:57.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.350+0000 7fa16e7fc640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa15c066690 0x7fa15c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.350+0000 7fa16e7fc640 1 -- 172.21.15.167:0/3544221572 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa174083890 con 0x7fa1780ada90 2024-09-13T17:24:57.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.350+0000 7fa17d439640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa15c066690 0x7fa15c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.350+0000 7fa17d439640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa15c066690 0x7fa15c068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1680af000 tx=0x7fa168008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:57.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.354+0000 7fa16e7fc640 1 -- 172.21.15.167:0/3544221572 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa17809d220 con 0x7fa1780ada90 2024-09-13T17:24:57.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.514+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17809d220 con 0x7fa1780ada90 2024-09-13T17:24:57.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa16e7fc640 1 -- 172.21.15.167:0/3544221572 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18815 (secure 0 0 0) 0x7fa17809d220 con 0x7fa1780ada90 2024-09-13T17:24:57.522 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:24:57.522 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":29,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:21:32.702162+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:57.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa15c066690 msgr2=0x7fa15c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa15c066690 0x7fa15c068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1680af000 tx=0x7fa168008040 comp rx=0 tx=0).stop 2024-09-13T17:24:57.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1780ada90 msgr2=0x7fa178070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1780ada90 0x7fa178070ea0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c370 tx=0x7fa17400c830 comp rx=0 tx=0).stop 2024-09-13T17:24:57.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 shutdown_connections 2024-09-13T17:24:57.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa15c066690 0x7fa15c068b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1781526b0 0x7fa17806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1780b2240 0x7fa17806f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 --2- 172.21.15.167:0/3544221572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1780ada90 0x7fa178070ea0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 >> 172.21.15.167:0/3544221572 conn(0x7fa1780b3c30 msgr2=0x7fa1780b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:57.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 shutdown_connections 2024-09-13T17:24:57.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:57.518+0000 7fa17fe9e640 1 -- 172.21.15.167:0/3544221572 wait complete. 2024-09-13T17:24:58.542 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T17:24:58.542 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:24:58.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefb16aa640 1 Processor -- start 2024-09-13T17:24:58.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefb16aa640 1 -- start start 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefb16aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fefac098a40 0x7fefac143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefb16aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac144490 con 0x7fefac0b3530 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefb16aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac09d410 con 0x7fefac143fe0 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefb16aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac09b090 con 0x7fefac098a40 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefaaffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fefac0b3530 0x7fefac09cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47434/0 (socket says 172.21.15.167:47434) 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefaaffd640 1 -- 172.21.15.167:0/445165998 learned_addr learned my addr 172.21.15.167:0/445165998 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefaa7fc640 1 --2- 172.21.15.167:0/445165998 >> v2:172.21.15.167:3300/0 conn(0x7fefac098a40 0x7fefac143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885150356 0 0) 0x7fefac144490 con 0x7fefac0b3530 2024-09-13T17:24:58.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef94003530 con 0x7fefac0b3530 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974427681 0 0) 0x7fef94003530 con 0x7fefac0b3530 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 >> v2:172.21.15.167:3300/0 conn(0x7fefac098a40 msgr2=0x7fefac143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 --2- 172.21.15.167:0/445165998 >> v2:172.21.15.167:3300/0 conn(0x7fefac098a40 0x7fefac143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 >> v1:172.21.15.190:6789/0 conn(0x7fefac143fe0 legacy=0x7fefac14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0b3910 con 0x7fefac0b3530 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fef9c001680 con 0x7fefac0b3530 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 >> v1:172.21.15.167:6789/0 conn(0x7fefac0b3530 legacy=0x7fefac09cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef94003980 0x7fef94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef940047d0 0x7fef94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef94005190 0x7fef9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac09b090 con 0x7fef94005190 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9400c030 con 0x7fef94003980 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9400c1f0 con 0x7fef940047d0 2024-09-13T17:24:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefab7fe640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef94005190 0x7fef9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefaaffd640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef94003980 0x7fef94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefab7fe640 1 -- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef940047d0 msgr2=0x7fef94004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:58.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefab7fe640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef940047d0 0x7fef94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefab7fe640 1 -- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef94003980 msgr2=0x7fef94003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:58.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefab7fe640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef94003980 0x7fef94003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefab7fe640 1 -- 172.21.15.167:0/445165998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94003530 con 0x7fef94005190 2024-09-13T17:24:58.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.678+0000 7fefaaffd640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef94003980 0x7fef94003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:58.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefab7fe640 1 -- 172.21.15.167:0/445165998 reap_dead start 2024-09-13T17:24:58.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefab7fe640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef94005190 0x7fef9400b990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefa4001e70 tx=0x7fefa401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfcacb4836e0de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4003b80 con 0x7fef94005190 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa4003d00 con 0x7fef94005190 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefa9ffb640 1 -- 172.21.15.167:0/445165998 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4005260 con 0x7fef94005190 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- 172.21.15.167:0/445165998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef94005190 msgr2=0x7fef9400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef94005190 0x7fef9400b990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefa4001e70 tx=0x7fefa401c780 comp rx=0 tx=0).stop 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- 172.21.15.167:0/445165998 shutdown_connections 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 --2- 172.21.15.167:0/445165998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef94005190 0x7fef9400b990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- 172.21.15.167:0/445165998 >> 172.21.15.167:0/445165998 conn(0x7fefac0b3b50 msgr2=0x7fefac0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- 172.21.15.167:0/445165998 shutdown_connections 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- 172.21.15.167:0/445165998 wait complete. 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 Processor -- start 2024-09-13T17:24:58.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- start start 2024-09-13T17:24:58.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94005190 0x7fefac146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefac1dc2d0 0x7fefac13e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefac13e600 0x7fefac13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac06e460 con 0x7fefac1dc2d0 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac140bb0 con 0x7fefac13e600 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefb16aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac13f8b0 con 0x7fef94005190 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefac1dc2d0 0x7fefac13e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefac1dc2d0 0x7fefac13e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58138/0 (socket says 172.21.15.167:58138) 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 -- 172.21.15.167:0/1702976651 learned_addr learned my addr 172.21.15.167:0/1702976651 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaaffd640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94005190 0x7fefac146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefab7fe640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefac13e600 0x7fefac13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 -- 172.21.15.167:0/1702976651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94005190 msgr2=0x7fefac146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef94005190 0x7fefac146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 -- 172.21.15.167:0/1702976651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefac13e600 msgr2=0x7fefac13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefac13e600 0x7fefac13ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.682+0000 7fefaa7fc640 1 -- 172.21.15.167:0/1702976651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac06f420 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefaa7fc640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefac1dc2d0 0x7fefac13e0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e7c0 tx=0x7fefa000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000ee70 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa000c940 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac06e640 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000ccf0 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac147460 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefac0991b0 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fefa0013470 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef98066690 0x7fef98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefaaffd640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef98066690 0x7fef98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fefa00848f0 con 0x7fefac1dc2d0 2024-09-13T17:24:58.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef9806fff0 0x7fef98072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 --> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef98072b60 con 0x7fef9806fff0 2024-09-13T17:24:58.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefa0084d40 con 0x7fefac1dc2d0 2024-09-13T17:24:58.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefab7fe640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef9806fff0 0x7fef98072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefaaffd640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef98066690 0x7fef98068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef9c001210 tx=0x7fef9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fefab7fe640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef9806fff0 0x7fef98072490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.686+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== osd.0 v2:172.21.15.167:6807/3243107293 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fef98072b60 con 0x7fef9806fff0 2024-09-13T17:24:58.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 --> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fefac098ed0 con 0x7fef9806fff0 2024-09-13T17:24:58.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fef937fe640 1 -- 172.21.15.167:0/1702976651 <== osd.0 v2:172.21.15.167:6807/3243107293 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fefa4003980 con 0x7fef9806fff0 2024-09-13T17:24:58.704 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:24:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:24:58.704 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:24:58.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef9806fff0 msgr2=0x7fef98072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6807/3243107293,v1:172.21.15.167:6809/3243107293] conn(0x7fef9806fff0 0x7fef98072490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef98066690 msgr2=0x7fef98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fef98066690 0x7fef98068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef9c001210 tx=0x7fef9c009040 comp rx=0 tx=0).stop 2024-09-13T17:24:58.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefac1dc2d0 msgr2=0x7fefac13e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 --2- 172.21.15.167:0/1702976651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefac1dc2d0 0x7fefac13e0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e7c0 tx=0x7fefa000ec80 comp rx=0 tx=0).stop 2024-09-13T17:24:58.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefab7fe640 1 -- 172.21.15.167:0/1702976651 reap_dead start 2024-09-13T17:24:58.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 shutdown_connections 2024-09-13T17:24:58.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 >> 172.21.15.167:0/1702976651 conn(0x7fefac0b3b50 msgr2=0x7fefac0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 shutdown_connections 2024-09-13T17:24:58.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.702+0000 7fefb16aa640 1 -- 172.21.15.167:0/1702976651 wait complete. 2024-09-13T17:24:58.720 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T17:24:58.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd559229640 1 Processor -- start 2024-09-13T17:24:58.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd559229640 1 -- start start 2024-09-13T17:24:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd559229640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 0x7fd554146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd559229640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd554145ee0 con 0x7fd55414e2f0 2024-09-13T17:24:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd559229640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55409d3a0 con 0x7fd5540b21c0 2024-09-13T17:24:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd559229640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b2f40 con 0x7fd5540ada20 2024-09-13T17:24:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55359e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd55414e2f0 0x7fd5541506e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47446/0 (socket says 172.21.15.167:47446) 2024-09-13T17:24:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55359e640 1 -- 172.21.15.167:0/1682238418 learned_addr learned my addr 172.21.15.167:0/1682238418 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd552d9d640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 0x7fd554146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303819403 0 0) 0x7fd554145ee0 con 0x7fd55414e2f0 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd53c003530 con 0x7fd55414e2f0 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472092361 0 0) 0x7fd53c003530 con 0x7fd55414e2f0 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 msgr2=0x7fd554146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 0x7fd554146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 >> v1:172.21.15.190:6789/0 conn(0x7fd5540b21c0 legacy=0x7fd5540b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554145b70 con 0x7fd55414e2f0 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fd54c001a00 con 0x7fd55414e2f0 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 >> v1:172.21.15.167:6789/0 conn(0x7fd55414e2f0 legacy=0x7fd5541506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c0039b0 0x7fd53c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 0x7fd53c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd53c004d10 0x7fd53c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b2f40 con 0x7fd53c004d10 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c00ba40 con 0x7fd53c0039b0 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c00bc00 con 0x7fd5540ada20 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55359e640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd53c004d10 0x7fd53c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd552d9d640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c0039b0 0x7fd53c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55259c640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 0x7fd53c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55359e640 1 -- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 msgr2=0x7fd53c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55359e640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540ada20 0x7fd53c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55359e640 1 -- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c0039b0 msgr2=0x7fd53c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.830+0000 7fd55359e640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c0039b0 0x7fd53c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd55359e640 1 -- 172.21.15.167:0/1682238418 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c003530 con 0x7fd53c004d10 2024-09-13T17:24:58.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd55359e640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd53c004d10 0x7fd53c005190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd55406df50 tx=0x7fd54c01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73470e2baecc1990 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0072d0 con 0x7fd53c004d10 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c0a8070 con 0x7fd53c004d10 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd551d9b640 1 -- 172.21.15.167:0/1682238418 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0076b0 con 0x7fd53c004d10 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd559229640 1 -- 172.21.15.167:0/1682238418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd53c004d10 msgr2=0x7fd53c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd559229640 1 --2- 172.21.15.167:0/1682238418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd53c004d10 0x7fd53c005190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd55406df50 tx=0x7fd54c01d300 comp rx=0 tx=0).stop 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd55359e640 1 -- 172.21.15.167:0/1682238418 reap_dead start 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd559229640 1 -- 172.21.15.167:0/1682238418 shutdown_connections 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd559229640 1 -- 172.21.15.167:0/1682238418 >> 172.21.15.167:0/1682238418 conn(0x7fd5540b3b50 msgr2=0x7fd5540b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd559229640 1 -- 172.21.15.167:0/1682238418 shutdown_connections 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.834+0000 7fd559229640 1 -- 172.21.15.167:0/1682238418 wait complete. 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 Processor -- start 2024-09-13T17:24:58.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 -- start start 2024-09-13T17:24:58.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c004d10 0x7fd55413d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540aeec0 0x7fd55413a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5540af340 0x7fd55413a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd554142610 con 0x7fd5540af340 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55413d620 con 0x7fd53c004d10 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540aea30 con 0x7fd5540aeec0 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5540af340 0x7fd55413a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5540af340 0x7fd55413a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58158/0 (socket says 172.21.15.167:58158) 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 -- 172.21.15.167:0/3285852795 learned_addr learned my addr 172.21.15.167:0/3285852795 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd552d9d640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c004d10 0x7fd55413d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55259c640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540aeec0 0x7fd55413a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 -- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540aeec0 msgr2=0x7fd55413a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540aeec0 0x7fd55413a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 -- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c004d10 msgr2=0x7fd55413d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c004d10 0x7fd55413d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 -- 172.21.15.167:0/3285852795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540b1bd0 con 0x7fd5540af340 2024-09-13T17:24:58.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd55359e640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5540af340 0x7fd55413a710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00a2c0 tx=0x7fd53c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd53b7fe640 1 -- 172.21.15.167:0/3285852795 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c004b70 con 0x7fd5540af340 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd53b7fe640 1 -- 172.21.15.167:0/3285852795 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c004cd0 con 0x7fd5540af340 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55413d880 con 0x7fd5540af340 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd53b7fe640 1 -- 172.21.15.167:0/3285852795 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0019c0 con 0x7fd5540af340 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd554149cf0 con 0x7fd5540af340 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5540ade00 con 0x7fd5540af340 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd53b7fe640 1 -- 172.21.15.167:0/3285852795 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd54c0aa030 con 0x7fd5540af340 2024-09-13T17:24:58.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd53b7fe640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5400666c0 0x7fd540068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd53b7fe640 1 -- 172.21.15.167:0/3285852795 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd54c11d060 con 0x7fd5540af340 2024-09-13T17:24:58.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd552d9d640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5400666c0 0x7fd540068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.838+0000 7fd552d9d640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5400666c0 0x7fd540068b80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd554142f40 tx=0x7fd548008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.842+0000 7fd53b7fe640 1 -- 172.21.15.167:0/3285852795 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd54c0ea080 con 0x7fd5540af340 2024-09-13T17:24:58.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.994+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5540b3860 con 0x7fd5400666c0 2024-09-13T17:24:58.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.994+0000 7fd53b7fe640 1 -- 172.21.15.167:0/3285852795 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd548014a90 con 0x7fd5400666c0 2024-09-13T17:24:58.999 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T17:24:59.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5400666c0 msgr2=0x7fd540068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5400666c0 0x7fd540068b80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd554142f40 tx=0x7fd548008040 comp rx=0 tx=0).stop 2024-09-13T17:24:59.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5540af340 msgr2=0x7fd55413a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5540af340 0x7fd55413a710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00a2c0 tx=0x7fd53c005800 comp rx=0 tx=0).stop 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 shutdown_connections 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd5400666c0 0x7fd540068b80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5540af340 0x7fd55413a710 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5540aeec0 0x7fd55413a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 --2- 172.21.15.167:0/3285852795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd53c004d10 0x7fd55413d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 >> 172.21.15.167:0/3285852795 conn(0x7fd5540b3b50 msgr2=0x7fd55413faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 shutdown_connections 2024-09-13T17:24:59.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:58.998+0000 7fd559229640 1 -- 172.21.15.167:0/3285852795 wait complete. 2024-09-13T17:24:59.018 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T17:24:59.018 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:24:59.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feaed0dd640 1 Processor -- start 2024-09-13T17:24:59.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feaed0dd640 1 -- start start 2024-09-13T17:24:59.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feaed0dd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feae80ace60 0x7feae814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feaed0dd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80ae000 con 0x7feae8071d00 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feaed0dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80ad290 con 0x7feae80aca80 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feaed0dd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80b2c00 con 0x7feae80ace60 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feae759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feae80ace60 0x7feae814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feae659c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feae8071d00 0x7feae809cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47448/0 (socket says 172.21.15.167:47448) 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feae659c640 1 -- 172.21.15.167:0/3165450455 learned_addr learned my addr 172.21.15.167:0/3165450455 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feae759e640 1 -- 172.21.15.167:0/3165450455 >> v1:172.21.15.190:6789/0 conn(0x7feae80aca80 legacy=0x7feae80b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feae759e640 1 -- 172.21.15.167:0/3165450455 >> v1:172.21.15.167:6789/0 conn(0x7feae8071d00 legacy=0x7feae809cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.142+0000 7feae759e640 1 -- 172.21.15.167:0/3165450455 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8145cb0 con 0x7feae80ace60 2024-09-13T17:24:59.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae759e640 1 --2- 172.21.15.167:0/3165450455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80ace60 0x7feae814dff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feae00097c0 tx=0x7feae001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215fffc645a2e6c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae5d9b640 1 -- 172.21.15.167:0/3165450455 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00ac600 con 0x7feae80ace60 2024-09-13T17:24:59.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae5d9b640 1 -- 172.21.15.167:0/3165450455 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae00a8050 con 0x7feae80ace60 2024-09-13T17:24:59.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae5d9b640 1 -- 172.21.15.167:0/3165450455 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00ac980 con 0x7feae80ace60 2024-09-13T17:24:59.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- 172.21.15.167:0/3165450455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80ace60 msgr2=0x7feae814dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 --2- 172.21.15.167:0/3165450455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80ace60 0x7feae814dff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feae00097c0 tx=0x7feae001c3a0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- 172.21.15.167:0/3165450455 shutdown_connections 2024-09-13T17:24:59.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 --2- 172.21.15.167:0/3165450455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80ace60 0x7feae814dff0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- 172.21.15.167:0/3165450455 >> 172.21.15.167:0/3165450455 conn(0x7feae80b3b50 msgr2=0x7feae80b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- 172.21.15.167:0/3165450455 shutdown_connections 2024-09-13T17:24:59.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- 172.21.15.167:0/3165450455 wait complete. 2024-09-13T17:24:59.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 Processor -- start 2024-09-13T17:24:59.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- start start 2024-09-13T17:24:59.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80aca80 0x7feae8141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feae80ace60 0x7feae8144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feae81e1440 0x7feae8137290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81e18d0 con 0x7feae80aca80 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81444c0 con 0x7feae81e1440 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae81447a0 con 0x7feae80ace60 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80aca80 0x7feae8141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80aca80 0x7feae8141d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58176/0 (socket says 172.21.15.167:58176) 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 -- 172.21.15.167:0/926593855 learned_addr learned my addr 172.21.15.167:0/926593855 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae659c640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feae80ace60 0x7feae8144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 -- 172.21.15.167:0/926593855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feae80ace60 msgr2=0x7feae8144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feae80ace60 0x7feae8144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 -- 172.21.15.167:0/926593855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feae81e1440 msgr2=0x7feae8137290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feae81e1440 0x7feae8137290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 -- 172.21.15.167:0/926593855 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0009420 con 0x7feae80aca80 2024-09-13T17:24:59.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feae6d9d640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80aca80 0x7feae8141d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fead800c450 tx=0x7fead800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8012830 con 0x7feae80aca80 2024-09-13T17:24:59.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead80129b0 con 0x7feae80aca80 2024-09-13T17:24:59.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8012d60 con 0x7feae80aca80 2024-09-13T17:24:59.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae806e8e0 con 0x7feae80aca80 2024-09-13T17:24:59.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.146+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8139190 con 0x7feae80aca80 2024-09-13T17:24:59.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feae8144630 con 0x7feae80aca80 2024-09-13T17:24:59.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fead801c460 con 0x7feae80aca80 2024-09-13T17:24:59.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feacf7fe640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fead4066690 0x7fead4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fead8084370 con 0x7feae80aca80 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feae659c640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fead4066690 0x7fead4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feacf7fe640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7fead406fff0 0x7fead4072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 --> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fead4072b60 con 0x7fead406fff0 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead8086a30 con 0x7feae80aca80 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feae759e640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7fead406fff0 0x7fead4072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feae659c640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fead4066690 0x7fead4068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feae81df000 tx=0x7feadc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feae759e640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7fead406fff0 0x7fead4072490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.150+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== osd.1 v2:172.21.15.167:6800/829452776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fead4072b60 con 0x7fead406fff0 2024-09-13T17:24:59.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.162+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 --> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feae80b37f0 con 0x7fead406fff0 2024-09-13T17:24:59.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.162+0000 7feacf7fe640 1 -- 172.21.15.167:0/926593855 <== osd.1 v2:172.21.15.167:6800/829452776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feae00ac580 con 0x7fead406fff0 2024-09-13T17:24:59.168 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:24:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:24:59.168 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7fead406fff0 msgr2=0x7fead4072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6800/829452776,v1:172.21.15.167:6801/829452776] conn(0x7fead406fff0 0x7fead4072490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fead4066690 msgr2=0x7fead4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fead4066690 0x7fead4068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feae81df000 tx=0x7feadc009040 comp rx=0 tx=0).stop 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80aca80 msgr2=0x7feae8141d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 --2- 172.21.15.167:0/926593855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feae80aca80 0x7feae8141d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fead800c450 tx=0x7fead800c910 comp rx=0 tx=0).stop 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feae759e640 1 -- 172.21.15.167:0/926593855 reap_dead start 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 shutdown_connections 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 >> 172.21.15.167:0/926593855 conn(0x7feae80b3b50 msgr2=0x7feae809a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 shutdown_connections 2024-09-13T17:24:59.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.166+0000 7feaed0dd640 1 -- 172.21.15.167:0/926593855 wait complete. 2024-09-13T17:24:59.184 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T17:24:59.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12d04b7640 1 Processor -- start 2024-09-13T17:24:59.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12d04b7640 1 -- start start 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12d04b7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f12c809a650 0x7f12c8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12d04b7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 0x7f12c8150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12d04b7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c806a3a0 con 0x7f12c80bada0 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12d04b7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c80b6c40 con 0x7f12c809a650 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12d04b7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c8145fd0 con 0x7f12c806a830 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12ce253640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f12c80bada0 0x7f12c8099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47452/0 (socket says 172.21.15.167:47452) 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12ce253640 1 -- 172.21.15.167:0/606525158 learned_addr learned my addr 172.21.15.167:0/606525158 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226254231 0 0) 0x7f12c806a3a0 con 0x7f12c80bada0 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b0003530 con 0x7f12c80bada0 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cda52640 1 --2- 172.21.15.167:0/606525158 >> v2:172.21.15.190:3300/0 conn(0x7f12c809a650 0x7f12c8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cea54640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 0x7f12c8150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3576393049 0 0) 0x7f12b0003530 con 0x7f12c80bada0 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 msgr2=0x7f12c8150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 0x7f12c8150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 >> v2:172.21.15.190:3300/0 conn(0x7f12c809a650 msgr2=0x7f12c8145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 --2- 172.21.15.167:0/606525158 >> v2:172.21.15.190:3300/0 conn(0x7f12c809a650 0x7f12c8145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c80bb180 con 0x7f12c80bada0 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f12c0001680 con 0x7f12c80bada0 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 >> v1:172.21.15.167:6789/0 conn(0x7f12c80bada0 legacy=0x7f12c8099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 0x7f12b0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12b0004d10 0x7f12b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c8145fd0 con 0x7f12b0003fb0 2024-09-13T17:24:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b000bad0 con 0x7f12b0004d10 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b000bc90 con 0x7f12c806a830 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cda52640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12ce253640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 0x7f12b0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cea54640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12b0004d10 0x7f12b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cda52640 1 -- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 msgr2=0x7f12b0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cda52640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 0x7f12b0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cda52640 1 -- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12b0004d10 msgr2=0x7f12b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cda52640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12b0004d10 0x7f12b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cda52640 1 -- 172.21.15.167:0/606525158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0003530 con 0x7f12b0003fb0 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12ce253640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c806a830 0x7f12b0003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.286+0000 7f12cea54640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12b0004d10 0x7f12b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:59.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12cda52640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12b00047d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00ba30 tx=0x7f12bc01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9940c52671d997d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0aa650 con 0x7f12b0003fb0 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0aa7b0 con 0x7f12b0003fb0 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12cd251640 1 -- 172.21.15.167:0/606525158 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0aab60 con 0x7f12b0003fb0 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- 172.21.15.167:0/606525158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 msgr2=0x7f12b00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 --2- 172.21.15.167:0/606525158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12b00047d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00ba30 tx=0x7f12bc01c6e0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12cea54640 1 -- 172.21.15.167:0/606525158 reap_dead start 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- 172.21.15.167:0/606525158 shutdown_connections 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- 172.21.15.167:0/606525158 >> 172.21.15.167:0/606525158 conn(0x7f12c80b7e40 msgr2=0x7f12c80b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- 172.21.15.167:0/606525158 shutdown_connections 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- 172.21.15.167:0/606525158 wait complete. 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 Processor -- start 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- start start 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12c81e1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c81e19d0 0x7f12c809fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c809ffd0 0x7f12c8141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80a0480 con 0x7f12b0003fb0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c809f5b0 con 0x7f12c809ffd0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c81e2020 con 0x7f12c81e19d0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12c81e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12c81e1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58188/0 (socket says 172.21.15.167:58188) 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 -- 172.21.15.167:0/1876750843 learned_addr learned my addr 172.21.15.167:0/1876750843 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 -- 172.21.15.167:0/1876750843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c81e19d0 msgr2=0x7f12c809fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c81e19d0 0x7f12c809fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 -- 172.21.15.167:0/1876750843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c809ffd0 msgr2=0x7f12c8141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12cea54640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c809ffd0 0x7f12c8141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c809ffd0 0x7f12c8141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 -- 172.21.15.167:0/1876750843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c813c770 con 0x7f12b0003fb0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12ce253640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12c81e1490 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12c0007fd0 tx=0x7f12c000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12c6ffd640 1 -- 172.21.15.167:0/1876750843 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c00074e0 con 0x7f12b0003fb0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12c6ffd640 1 -- 172.21.15.167:0/1876750843 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c0007640 con 0x7f12b0003fb0 2024-09-13T17:24:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c8143190 con 0x7f12b0003fb0 2024-09-13T17:24:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12c6ffd640 1 -- 172.21.15.167:0/1876750843 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c00049f0 con 0x7f12b0003fb0 2024-09-13T17:24:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.290+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c80a11f0 con 0x7f12b0003fb0 2024-09-13T17:24:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.294+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c8145a90 con 0x7f12b0003fb0 2024-09-13T17:24:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.294+0000 7f12c6ffd640 1 -- 172.21.15.167:0/1876750843 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12c0004b50 con 0x7f12b0003fb0 2024-09-13T17:24:59.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.294+0000 7f12c6ffd640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f12b4066690 0x7f12b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.294+0000 7f12cda52640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f12b4066690 0x7f12b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.294+0000 7f12c6ffd640 1 -- 172.21.15.167:0/1876750843 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f12c0083ff0 con 0x7f12b0003fb0 2024-09-13T17:24:59.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.294+0000 7f12cda52640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f12b4066690 0x7f12b4068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0af000 tx=0x7f12bc0ac040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.298+0000 7f12c6ffd640 1 -- 172.21.15.167:0/1876750843 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12c0051030 con 0x7f12b0003fb0 2024-09-13T17:24:59.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.446+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f12c81e1ea0 con 0x7f12b4066690 2024-09-13T17:24:59.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.446+0000 7f12c6ffd640 1 -- 172.21.15.167:0/1876750843 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f12bc0b6070 con 0x7f12b4066690 2024-09-13T17:24:59.450 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T17:24:59.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f12b4066690 msgr2=0x7f12b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f12b4066690 0x7f12b4068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0af000 tx=0x7f12bc0ac040 comp rx=0 tx=0).stop 2024-09-13T17:24:59.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 msgr2=0x7f12c81e1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12c81e1490 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12c0007fd0 tx=0x7f12c000dd40 comp rx=0 tx=0).stop 2024-09-13T17:24:59.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 shutdown_connections 2024-09-13T17:24:59.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f12b4066690 0x7f12b4068b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c809ffd0 0x7f12c8141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12c81e19d0 0x7f12c809fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 --2- 172.21.15.167:0/1876750843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12b0003fb0 0x7f12c81e1490 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 >> 172.21.15.167:0/1876750843 conn(0x7f12c80b7e40 msgr2=0x7f12c81449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 shutdown_connections 2024-09-13T17:24:59.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.450+0000 7f12d04b7640 1 -- 172.21.15.167:0/1876750843 wait complete. 2024-09-13T17:24:59.468 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T17:24:59.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:24:59.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a7d72d640 1 Processor -- start 2024-09-13T17:24:59.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a7d72d640 1 -- start start 2024-09-13T17:24:59.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a7d72d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 0x7f6a78070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a7d72d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a78072300 con 0x7f6a780b45f0 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a7d72d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a78144320 con 0x7f6a780b4210 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a7d72d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a78144600 con 0x7f6a78141090 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a777fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6a780b45f0 0x7f6a7814e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47460/0 (socket says 172.21.15.167:47460) 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a777fe640 1 -- 172.21.15.167:0/1228078532 learned_addr learned my addr 172.21.15.167:0/1228078532 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a767fc640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 0x7f6a78070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255239079 0 0) 0x7f6a78072300 con 0x7f6a780b45f0 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a60003530 con 0x7f6a780b45f0 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722791591 0 0) 0x7f6a60003530 con 0x7f6a780b45f0 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 msgr2=0x7f6a78070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 0x7f6a78070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 >> v1:172.21.15.190:6789/0 conn(0x7f6a780b4210 legacy=0x7f6a78140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7806e890 con 0x7f6a780b45f0 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f6a70001a00 con 0x7f6a780b45f0 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 >> v1:172.21.15.167:6789/0 conn(0x7f6a780b45f0 legacy=0x7f6a7814e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 0x7f6a600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60003f30 0x7f6a600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a60004d10 0x7f6a60005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a78144600 con 0x7f6a60003f30 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6000bb20 con 0x7f6a60004d10 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6000bce0 con 0x7f6a78141090 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a767fc640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60003f30 0x7f6a600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a777fe640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a60004d10 0x7f6a60005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a76ffd640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 0x7f6a600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a767fc640 1 -- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 msgr2=0x7f6a600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a767fc640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a78141090 0x7f6a600039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a767fc640 1 -- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a60004d10 msgr2=0x7f6a60005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a767fc640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a60004d10 0x7f6a60005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a767fc640 1 -- 172.21.15.167:0/1228078532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60003530 con 0x7f6a60003f30 2024-09-13T17:24:59.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.586+0000 7f6a777fe640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a60004d10 0x7f6a60005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a767fc640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60003f30 0x7f6a600047d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009ab0 tx=0x7f6a6c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72c33e6b15950eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0a9470 con 0x7f6a60003f30 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0a95d0 con 0x7f6a60003f30 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a75ffb640 1 -- 172.21.15.167:0/1228078532 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0a9940 con 0x7f6a60003f30 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 -- 172.21.15.167:0/1228078532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60003f30 msgr2=0x7f6a600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 --2- 172.21.15.167:0/1228078532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60003f30 0x7f6a600047d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009ab0 tx=0x7f6a6c01c990 comp rx=0 tx=0).stop 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a777fe640 1 -- 172.21.15.167:0/1228078532 reap_dead start 2024-09-13T17:24:59.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 -- 172.21.15.167:0/1228078532 shutdown_connections 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 -- 172.21.15.167:0/1228078532 >> 172.21.15.167:0/1228078532 conn(0x7f6a7809b150 msgr2=0x7f6a7809b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 -- 172.21.15.167:0/1228078532 shutdown_connections 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 -- 172.21.15.167:0/1228078532 wait complete. 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 Processor -- start 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 -- start start 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a7809d1c0 0x7f6a781dc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a781dc7d0 0x7f6a7813d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.590+0000 7f6a7d72d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a7813dad0 0x7f6a781df800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a7d72d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a781dcc50 con 0x7f6a7813dad0 2024-09-13T17:24:59.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a7d72d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7809d5a0 con 0x7f6a7809d1c0 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a7d72d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7809eb60 con 0x7f6a781dc7d0 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a7813dad0 0x7f6a781df800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a7813dad0 0x7f6a781df800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58214/0 (socket says 172.21.15.167:58214) 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 -- 172.21.15.167:0/2736299868 learned_addr learned my addr 172.21.15.167:0/2736299868 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a76ffd640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a7809d1c0 0x7f6a781dc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a767fc640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a781dc7d0 0x7f6a7813d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 -- 172.21.15.167:0/2736299868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a781dc7d0 msgr2=0x7f6a7813d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a781dc7d0 0x7f6a7813d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 -- 172.21.15.167:0/2736299868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a7809d1c0 msgr2=0x7f6a781dc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a7809d1c0 0x7f6a781dc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 -- 172.21.15.167:0/2736299868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7809ee40 con 0x7f6a7813dad0 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a777fe640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a7813dad0 0x7f6a781df800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a780702e0 tx=0x7f6a7000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000bd80 con 0x7f6a7813dad0 2024-09-13T17:24:59.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a700070d0 con 0x7f6a7813dad0 2024-09-13T17:24:59.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7809c4f0 con 0x7f6a7813dad0 2024-09-13T17:24:59.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000bee0 con 0x7f6a7813dad0 2024-09-13T17:24:59.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7809dc80 con 0x7f6a7813dad0 2024-09-13T17:24:59.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a7809c8a0 con 0x7f6a7813dad0 2024-09-13T17:24:59.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a70007480 con 0x7f6a7813dad0 2024-09-13T17:24:59.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6a640666c0 0x7f6a64068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6a70084770 con 0x7f6a7813dad0 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a76ffd640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6a640666c0 0x7f6a64068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7f6a64070020 0x7f6a640724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 --> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a64072b90 con 0x7f6a64070020 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a70086e30 con 0x7f6a7813dad0 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a767fc640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7f6a64070020 0x7f6a640724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a76ffd640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6a640666c0 0x7f6a64068b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a68007fd0 tx=0x7f6a68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.594+0000 7f6a767fc640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7f6a64070020 0x7f6a640724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.598+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== osd.2 v2:172.21.15.167:6816/3360843643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6a64072b90 con 0x7f6a64070020 2024-09-13T17:24:59.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 --> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a78140980 con 0x7f6a64070020 2024-09-13T17:24:59.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a5f7fe640 1 -- 172.21.15.167:0/2736299868 <== osd.2 v2:172.21.15.167:6816/3360843643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6a78140980 con 0x7f6a64070020 2024-09-13T17:24:59.613 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:24:59.613 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:24:59.613 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:24:59.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7f6a64070020 msgr2=0x7f6a640724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6816/3360843643,v1:172.21.15.167:6818/3360843643] conn(0x7f6a64070020 0x7f6a640724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6a640666c0 msgr2=0x7f6a64068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6a640666c0 0x7f6a64068b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a68007fd0 tx=0x7f6a68009040 comp rx=0 tx=0).stop 2024-09-13T17:24:59.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a7813dad0 msgr2=0x7f6a781df800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 --2- 172.21.15.167:0/2736299868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a7813dad0 0x7f6a781df800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a780702e0 tx=0x7f6a7000b4a0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a777fe640 1 -- 172.21.15.167:0/2736299868 reap_dead start 2024-09-13T17:24:59.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 shutdown_connections 2024-09-13T17:24:59.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 >> 172.21.15.167:0/2736299868 conn(0x7f6a7809b150 msgr2=0x7f6a780b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 shutdown_connections 2024-09-13T17:24:59.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.610+0000 7f6a7d72d640 1 -- 172.21.15.167:0/2736299868 wait complete. 2024-09-13T17:24:59.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T17:24:59.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f2cee640 1 Processor -- start 2024-09-13T17:24:59.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f2cee640 1 -- start start 2024-09-13T17:24:59.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f2cee640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 0x7f00ec1490b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f2cee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec0ad970 con 0x7f00ec1495f0 2024-09-13T17:24:59.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f2cee640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec149aa0 con 0x7f00ec0b56b0 2024-09-13T17:24:59.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f2cee640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0adb40 con 0x7f00ec0aef00 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f128b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f00ec1495f0 0x7f00ec150160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47474/0 (socket says 172.21.15.167:47474) 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f128b640 1 -- 172.21.15.167:0/3290117300 learned_addr learned my addr 172.21.15.167:0/3290117300 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00ebfff640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 0x7f00ec1490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568423465 0 0) 0x7f00ec0ad970 con 0x7f00ec1495f0 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00dc003530 con 0x7f00ec1495f0 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860337083 0 0) 0x7f00dc003530 con 0x7f00ec1495f0 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 msgr2=0x7f00ec1490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 0x7f00ec1490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 >> v1:172.21.15.190:6789/0 conn(0x7f00ec0b56b0 legacy=0x7f00ec13f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec0b5a90 con 0x7f00ec1495f0 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f00e4001a00 con 0x7f00ec1495f0 2024-09-13T17:24:59.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 >> v1:172.21.15.167:6789/0 conn(0x7f00ec1495f0 legacy=0x7f00ec150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc0039b0 0x7f00dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00dc0047d0 0x7f00dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 0x7f00dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0adb40 con 0x7f00dc0039b0 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00bac0 con 0x7f00dc0047d0 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00bc80 con 0x7f00ec0aef00 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f0a8a640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc0039b0 0x7f00dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f128b640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 0x7f00dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f0a8a640 1 -- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 msgr2=0x7f00dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00ebfff640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00dc0047d0 0x7f00dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f0a8a640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec0aef00 0x7f00dc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f0a8a640 1 -- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00dc0047d0 msgr2=0x7f00dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:59.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f0a8a640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00dc0047d0 0x7f00dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00f0a8a640 1 -- 172.21.15.167:0/3290117300 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc003530 con 0x7f00dc0039b0 2024-09-13T17:24:59.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.738+0000 7f00ebfff640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00dc0047d0 0x7f00dc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:59.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f0a8a640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc0039b0 0x7f00dc003dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f00e0001780 tx=0x7f00e001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86208f396ee8eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00052d0 con 0x7f00dc0039b0 2024-09-13T17:24:59.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e00a7050 con 0x7f00dc0039b0 2024-09-13T17:24:59.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00eb7fe640 1 -- 172.21.15.167:0/3290117300 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0003600 con 0x7f00dc0039b0 2024-09-13T17:24:59.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 -- 172.21.15.167:0/3290117300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc0039b0 msgr2=0x7f00dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 --2- 172.21.15.167:0/3290117300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc0039b0 0x7f00dc003dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f00e0001780 tx=0x7f00e001c420 comp rx=0 tx=0).stop 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f128b640 1 -- 172.21.15.167:0/3290117300 reap_dead start 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 -- 172.21.15.167:0/3290117300 shutdown_connections 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 -- 172.21.15.167:0/3290117300 >> 172.21.15.167:0/3290117300 conn(0x7f00ec0b8840 msgr2=0x7f00ec0b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 -- 172.21.15.167:0/3290117300 shutdown_connections 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 -- 172.21.15.167:0/3290117300 wait complete. 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 Processor -- start 2024-09-13T17:24:59.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.742+0000 7f00f2cee640 1 -- start start 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec13c890 0x7f00ec1de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00ec13a9a0 0x7f00ec13ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00ec06feb0 0x7f00ec070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec13b340 con 0x7f00ec06feb0 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec143e70 con 0x7f00ec13a9a0 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec070870 con 0x7f00ec13c890 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00ec06feb0 0x7f00ec070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00ec06feb0 0x7f00ec070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58228/0 (socket says 172.21.15.167:58228) 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 -- 172.21.15.167:0/2655826412 learned_addr learned my addr 172.21.15.167:0/2655826412 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00ebfff640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00ec13a9a0 0x7f00ec13ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f0a8a640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec13c890 0x7f00ec1de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 -- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec13c890 msgr2=0x7f00ec1de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec13c890 0x7f00ec1de3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 -- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00ec13a9a0 msgr2=0x7f00ec13ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00ec13a9a0 0x7f00ec13ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 -- 172.21.15.167:0/2655826412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec13cc70 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00ebfff640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00ec13a9a0 0x7f00ec13ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f128b640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00ec06feb0 0x7f00ec070330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00dc004750 tx=0x7f00e400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00e97fa640 1 -- 172.21.15.167:0/2655826412 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400bd80 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00e97fa640 1 -- 172.21.15.167:0/2655826412 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e4001a40 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec1dec20 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00e97fa640 1 -- 172.21.15.167:0/2655826412 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4007310 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec1df1e0 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec13f6a0 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00e97fa640 1 -- 172.21.15.167:0/2655826412 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f00e4007470 con 0x7f00ec06feb0 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00e97fa640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f00d0066690 0x7f00d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00e97fa640 1 -- 172.21.15.167:0/2655826412 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f00e4084880 con 0x7f00ec06feb0 2024-09-13T17:24:59.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f0a8a640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f00d0066690 0x7f00d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.746+0000 7f00f0a8a640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f00d0066690 0x7f00d0068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f00e0001750 tx=0x7f00e00011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.750+0000 7f00e97fa640 1 -- 172.21.15.167:0/2655826412 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00e40518a0 con 0x7f00ec06feb0 2024-09-13T17:24:59.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f00ec13fdb0 con 0x7f00d0066690 2024-09-13T17:24:59.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00e97fa640 1 -- 172.21.15.167:0/2655826412 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f00e0005370 con 0x7f00d0066690 2024-09-13T17:24:59.905 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f00d0066690 msgr2=0x7f00d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f00d0066690 0x7f00d0068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f00e0001750 tx=0x7f00e00011a0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00ec06feb0 msgr2=0x7f00ec070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00ec06feb0 0x7f00ec070330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00dc004750 tx=0x7f00e400b4a0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 shutdown_connections 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f00d0066690 0x7f00d0068b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00ec06feb0 0x7f00ec070330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00ec13a9a0 0x7f00ec13ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 --2- 172.21.15.167:0/2655826412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00ec13c890 0x7f00ec1de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 >> 172.21.15.167:0/2655826412 conn(0x7f00ec0b8840 msgr2=0x7f00ec0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 shutdown_connections 2024-09-13T17:24:59.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:24:59.902+0000 7f00f2cee640 1 -- 172.21.15.167:0/2655826412 wait complete. 2024-09-13T17:24:59.923 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T17:24:59.923 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:25:00.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8189aa4640 1 Processor -- start 2024-09-13T17:25:00.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8189aa4640 1 -- start start 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8189aa4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f81840b1810 0x7f81840704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8189aa4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81840b1bf0 0x7f8184142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8189aa4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818406f2c0 con 0x7f818406f750 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8189aa4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8184070b50 con 0x7f81840b1bf0 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8189aa4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818413cd20 con 0x7f81840b1810 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8182ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81840b1bf0 0x7f8184142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8182ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81840b1bf0 0x7f8184142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58230/0 (socket says 172.21.15.167:58230) 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8182ffd640 1 -- 172.21.15.167:0/1750123195 learned_addr learned my addr 172.21.15.167:0/1750123195 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f81837fe640 1 --2- 172.21.15.167:0/1750123195 >> v2:172.21.15.190:3300/0 conn(0x7f81840b1810 0x7f81840704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8182ffd640 1 -- 172.21.15.167:0/1750123195 >> v2:172.21.15.190:3300/0 conn(0x7f81840b1810 msgr2=0x7f81840704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8182ffd640 1 --2- 172.21.15.167:0/1750123195 >> v2:172.21.15.190:3300/0 conn(0x7f81840b1810 0x7f81840704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8182ffd640 1 -- 172.21.15.167:0/1750123195 >> v1:172.21.15.190:6789/0 conn(0x7f818406f750 legacy=0x7f8184065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.034+0000 7f8182ffd640 1 -- 172.21.15.167:0/1750123195 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818406ef50 con 0x7f81840b1bf0 2024-09-13T17:25:00.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8182ffd640 1 --2- 172.21.15.167:0/1750123195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1bf0 0x7f8184142580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f81840664e0 tx=0x7f817801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c55cd32b8d855e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f81827fc640 1 -- 172.21.15.167:0/1750123195 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780ab600 con 0x7f81840b1bf0 2024-09-13T17:25:00.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f81827fc640 1 -- 172.21.15.167:0/1750123195 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81780a7050 con 0x7f81840b1bf0 2024-09-13T17:25:00.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f81827fc640 1 -- 172.21.15.167:0/1750123195 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780ab980 con 0x7f81840b1bf0 2024-09-13T17:25:00.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- 172.21.15.167:0/1750123195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1bf0 msgr2=0x7f8184142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 --2- 172.21.15.167:0/1750123195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1bf0 0x7f8184142580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f81840664e0 tx=0x7f817801c450 comp rx=0 tx=0).stop 2024-09-13T17:25:00.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- 172.21.15.167:0/1750123195 shutdown_connections 2024-09-13T17:25:00.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 --2- 172.21.15.167:0/1750123195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1bf0 0x7f8184142580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 --2- 172.21.15.167:0/1750123195 >> v2:172.21.15.190:3300/0 conn(0x7f81840b1810 0x7f81840704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- 172.21.15.167:0/1750123195 >> 172.21.15.167:0/1750123195 conn(0x7f8184069f80 msgr2=0x7f818406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- 172.21.15.167:0/1750123195 shutdown_connections 2024-09-13T17:25:00.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- 172.21.15.167:0/1750123195 wait complete. 2024-09-13T17:25:00.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 Processor -- start 2024-09-13T17:25:00.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- start start 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f818406f750 0x7f81840a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1810 0x7f81840a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81840b1bf0 0x7f81840a8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81840aa050 con 0x7f81840b1810 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81840a9d70 con 0x7f818406f750 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8189aa4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81841db030 con 0x7f81840b1bf0 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8182ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1810 0x7f81840a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.038+0000 7f8182ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1810 0x7f81840a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58236/0 (socket says 172.21.15.167:58236) 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8182ffd640 1 -- 172.21.15.167:0/2898541816 learned_addr learned my addr 172.21.15.167:0/2898541816 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8182ffd640 1 -- 172.21.15.167:0/2898541816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81840b1bf0 msgr2=0x7f81840a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f81837fe640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f818406f750 0x7f81840a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8182ffd640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81840b1bf0 0x7f81840a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8182ffd640 1 -- 172.21.15.167:0/2898541816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f818406f750 msgr2=0x7f81840a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8182ffd640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f818406f750 0x7f81840a7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8182ffd640 1 -- 172.21.15.167:0/2898541816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780094d0 con 0x7f81840b1810 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8182ffd640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1810 0x7f81840a7d50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f81780ae040 tx=0x7f81780191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780b4640 con 0x7f81840b1810 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81780b47a0 con 0x7f81840b1810 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81841db310 con 0x7f81840b1810 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780b4b30 con 0x7f81840b1810 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818413f1a0 con 0x7f81840b1810 2024-09-13T17:25:00.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81840704c0 con 0x7f81840b1810 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81780b2070 con 0x7f81840b1810 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8170066690 0x7f8170068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f817811e410 con 0x7f81840b1810 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f81837fe640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8170066690 0x7f8170068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f817006fff0 0x7f8170072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 --> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8170072b60 con 0x7f817006fff0 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8178120a70 con 0x7f81840b1810 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8183fff640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f817006fff0 0x7f8170072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f81837fe640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8170066690 0x7f8170068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f817400b800 tx=0x7f8174008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.042+0000 7f8183fff640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f817006fff0 0x7f8170072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.046+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== osd.3 v2:172.21.15.167:6817/2142249193 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8170072b60 con 0x7f817006fff0 2024-09-13T17:25:00.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 --> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81841db7c0 con 0x7f817006fff0 2024-09-13T17:25:00.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f816bfff640 1 -- 172.21.15.167:0/2898541816 <== osd.3 v2:172.21.15.167:6817/2142249193 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f81841db7c0 con 0x7f817006fff0 2024-09-13T17:25:00.061 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:25:00.061 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:25:00.061 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:25:00.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f817006fff0 msgr2=0x7f8170072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6817/2142249193,v1:172.21.15.167:6819/2142249193] conn(0x7f817006fff0 0x7f8170072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8170066690 msgr2=0x7f8170068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f8170066690 0x7f8170068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f817400b800 tx=0x7f8174008040 comp rx=0 tx=0).stop 2024-09-13T17:25:00.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1810 msgr2=0x7f81840a7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 --2- 172.21.15.167:0/2898541816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81840b1810 0x7f81840a7d50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f81780ae040 tx=0x7f81780191f0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8183fff640 1 -- 172.21.15.167:0/2898541816 reap_dead start 2024-09-13T17:25:00.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 shutdown_connections 2024-09-13T17:25:00.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 >> 172.21.15.167:0/2898541816 conn(0x7f8184069f80 msgr2=0x7f81840b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 shutdown_connections 2024-09-13T17:25:00.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.058+0000 7f8189aa4640 1 -- 172.21.15.167:0/2898541816 wait complete. 2024-09-13T17:25:00.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T17:25:00.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c60229640 1 Processor -- start 2024-09-13T17:25:00.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c60229640 1 -- start start 2024-09-13T17:25:00.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c60229640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 0x7f7c5814f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c60229640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5809d410 con 0x7f7c580b3530 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c60229640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580b3910 con 0x7f7c58098a40 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c60229640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5809b090 con 0x7f7c581441b0 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5dfc5640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7c580b3530 0x7f7c5809cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47478/0 (socket says 172.21.15.167:47478) 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5dfc5640 1 -- 172.21.15.167:0/1587824170 learned_addr learned my addr 172.21.15.167:0/1587824170 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5e7c6640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 0x7f7c5814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226608931 0 0) 0x7f7c5809d410 con 0x7f7c580b3530 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c44003530 con 0x7f7c580b3530 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521618103 0 0) 0x7f7c44003530 con 0x7f7c580b3530 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 msgr2=0x7f7c5814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 0x7f7c5814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 >> v1:172.21.15.190:6789/0 conn(0x7f7c58098a40 legacy=0x7f7c58143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58099490 con 0x7f7c580b3530 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f7c54001680 con 0x7f7c580b3530 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 >> v1:172.21.15.167:6789/0 conn(0x7f7c580b3530 legacy=0x7f7c5809cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c440039b0 0x7f7c44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c440047d0 0x7f7c44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 0x7f7c44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5809b090 con 0x7f7c440047d0 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4400ba70 con 0x7f7c440039b0 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4400bc30 con 0x7f7c581441b0 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5d7c4640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c440047d0 0x7f7c44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5dfc5640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c440039b0 0x7f7c44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5e7c6640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 0x7f7c44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5d7c4640 1 -- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 msgr2=0x7f7c44005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5d7c4640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c581441b0 0x7f7c44005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5d7c4640 1 -- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c440039b0 msgr2=0x7f7c44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5d7c4640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c440039b0 0x7f7c44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.186+0000 7f7c5d7c4640 1 -- 172.21.15.167:0/1587824170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44003530 con 0x7f7c440047d0 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5d7c4640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c440047d0 0x7f7c44004c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c48001750 tx=0x7f7c4801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d5ef720161e445 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480052d0 con 0x7f7c440047d0 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c480a7050 con 0x7f7c440047d0 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5cfc3640 1 -- 172.21.15.167:0/1587824170 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48003600 con 0x7f7c440047d0 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- 172.21.15.167:0/1587824170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c440047d0 msgr2=0x7f7c44004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 --2- 172.21.15.167:0/1587824170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c440047d0 0x7f7c44004c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c48001750 tx=0x7f7c4801c3c0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 -- 172.21.15.167:0/1587824170 reap_dead start 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- 172.21.15.167:0/1587824170 shutdown_connections 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- 172.21.15.167:0/1587824170 >> 172.21.15.167:0/1587824170 conn(0x7f7c580b3b50 msgr2=0x7f7c580b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- 172.21.15.167:0/1587824170 shutdown_connections 2024-09-13T17:25:00.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- 172.21.15.167:0/1587824170 wait complete. 2024-09-13T17:25:00.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 Processor -- start 2024-09-13T17:25:00.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- start start 2024-09-13T17:25:00.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c440047d0 0x7f7c580b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c58140680 0x7f7c5813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5813d310 0x7f7c5813d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5806f340 con 0x7f7c5813d310 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5813dcd0 con 0x7f7c58140680 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c60229640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5813fd60 con 0x7f7c440047d0 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5813d310 0x7f7c5813d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5813d310 0x7f7c5813d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58244/0 (socket says 172.21.15.167:58244) 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 -- 172.21.15.167:0/3903695528 learned_addr learned my addr 172.21.15.167:0/3903695528 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5dfc5640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c440047d0 0x7f7c580b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5d7c4640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c58140680 0x7f7c5813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 -- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c440047d0 msgr2=0x7f7c580b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c440047d0 0x7f7c580b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 -- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c58140680 msgr2=0x7f7c5813e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c58140680 0x7f7c5813e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5e7c6640 1 -- 172.21.15.167:0/3903695528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5806f590 con 0x7f7c5813d310 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.190+0000 7f7c5d7c4640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c58140680 0x7f7c5813e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c5e7c6640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5813d310 0x7f7c5813d790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c58141380 tx=0x7f7c5000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c4e7fc640 1 -- 172.21.15.167:0/3903695528 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50017400 con 0x7f7c5813d310 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c4e7fc640 1 -- 172.21.15.167:0/3903695528 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50011040 con 0x7f7c5813d310 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c4e7fc640 1 -- 172.21.15.167:0/3903695528 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500177c0 con 0x7f7c5813d310 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c58140e00 con 0x7f7c5813d310 2024-09-13T17:25:00.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5813f6e0 con 0x7f7c5813d310 2024-09-13T17:25:00.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c58099cb0 con 0x7f7c5813d310 2024-09-13T17:25:00.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c4e7fc640 1 -- 172.21.15.167:0/3903695528 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c50021440 con 0x7f7c5813d310 2024-09-13T17:25:00.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c4e7fc640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7c3c066690 0x7f7c3c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c4e7fc640 1 -- 172.21.15.167:0/3903695528 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7c500847b0 con 0x7f7c5813d310 2024-09-13T17:25:00.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c5dfc5640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7c3c066690 0x7f7c3c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.194+0000 7f7c5dfc5640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7c3c066690 0x7f7c3c068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7c540052a0 tx=0x7f7c54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.198+0000 7f7c4e7fc640 1 -- 172.21.15.167:0/3903695528 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c500517d0 con 0x7f7c5813d310 2024-09-13T17:25:00.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c5813fbe0 con 0x7f7c3c066690 2024-09-13T17:25:00.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c4e7fc640 1 -- 172.21.15.167:0/3903695528 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c54000ee0 con 0x7f7c3c066690 2024-09-13T17:25:00.357 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T17:25:00.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7c3c066690 msgr2=0x7f7c3c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7c3c066690 0x7f7c3c068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7c540052a0 tx=0x7f7c54009040 comp rx=0 tx=0).stop 2024-09-13T17:25:00.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5813d310 msgr2=0x7f7c5813d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5813d310 0x7f7c5813d790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c58141380 tx=0x7f7c5000f4a0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 shutdown_connections 2024-09-13T17:25:00.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7c3c066690 0x7f7c3c068b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5813d310 0x7f7c5813d790 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c58140680 0x7f7c5813e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 --2- 172.21.15.167:0/3903695528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c440047d0 0x7f7c580b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 >> 172.21.15.167:0/3903695528 conn(0x7f7c580b3b50 msgr2=0x7f7c58143140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 shutdown_connections 2024-09-13T17:25:00.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.354+0000 7f7c60229640 1 -- 172.21.15.167:0/3903695528 wait complete. 2024-09-13T17:25:00.375 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T17:25:00.375 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:25:00.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11493d9640 1 Processor -- start 2024-09-13T17:25:00.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11493d9640 1 -- start start 2024-09-13T17:25:00.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11493d9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f114409a4f0 0x7f11440b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11493d9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1144144100 0x7f114409a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11493d9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1144143c70 con 0x7f114406a6e0 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11493d9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11440b4bc0 con 0x7f1144144100 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11493d9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1144143940 con 0x7f114409a4f0 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11427fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1144144100 0x7f114409a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11427fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1144144100 0x7f114409a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58258/0 (socket says 172.21.15.167:58258) 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11427fc640 1 -- 172.21.15.167:0/296254113 learned_addr learned my addr 172.21.15.167:0/296254113 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f1142ffd640 1 --2- 172.21.15.167:0/296254113 >> v2:172.21.15.190:3300/0 conn(0x7f114409a4f0 0x7f11440b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11427fc640 1 -- 172.21.15.167:0/296254113 >> v2:172.21.15.190:3300/0 conn(0x7f114409a4f0 msgr2=0x7f11440b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11427fc640 1 --2- 172.21.15.167:0/296254113 >> v2:172.21.15.190:3300/0 conn(0x7f114409a4f0 0x7f11440b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11427fc640 1 -- 172.21.15.167:0/296254113 >> v1:172.21.15.190:6789/0 conn(0x7f114406a6e0 legacy=0x7f1144146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.494+0000 7f11427fc640 1 -- 172.21.15.167:0/296254113 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440b4100 con 0x7f1144144100 2024-09-13T17:25:00.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11427fc640 1 --2- 172.21.15.167:0/296254113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1144144100 0x7f114409a8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1138009870 tx=0x7f113801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931ae07bc6a6ba48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f1141ffb640 1 -- 172.21.15.167:0/296254113 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380ab600 con 0x7f1144144100 2024-09-13T17:25:00.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f1141ffb640 1 -- 172.21.15.167:0/296254113 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380a7050 con 0x7f1144144100 2024-09-13T17:25:00.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f1141ffb640 1 -- 172.21.15.167:0/296254113 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380ab980 con 0x7f1144144100 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 -- 172.21.15.167:0/296254113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1144144100 msgr2=0x7f114409a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 --2- 172.21.15.167:0/296254113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1144144100 0x7f114409a8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1138009870 tx=0x7f113801c450 comp rx=0 tx=0).stop 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 -- 172.21.15.167:0/296254113 shutdown_connections 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 --2- 172.21.15.167:0/296254113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1144144100 0x7f114409a8d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 --2- 172.21.15.167:0/296254113 >> v2:172.21.15.190:3300/0 conn(0x7f114409a4f0 0x7f11440b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 -- 172.21.15.167:0/296254113 >> 172.21.15.167:0/296254113 conn(0x7f11440b4db0 msgr2=0x7f11440b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 -- 172.21.15.167:0/296254113 shutdown_connections 2024-09-13T17:25:00.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.498+0000 7f11493d9640 1 -- 172.21.15.167:0/296254113 wait complete. 2024-09-13T17:25:00.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 Processor -- start 2024-09-13T17:25:00.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 -- start start 2024-09-13T17:25:00.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114406a6e0 0x7f114409ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f114409a4f0 0x7f114409dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1144144100 0x7f114409e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114409cfa0 con 0x7f114409a4f0 2024-09-13T17:25:00.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440b26a0 con 0x7f1144144100 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114409d220 con 0x7f114406a6e0 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f114409a4f0 0x7f114409dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f114409a4f0 0x7f114409dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58270/0 (socket says 172.21.15.167:58270) 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 -- 172.21.15.167:0/2361018973 learned_addr learned my addr 172.21.15.167:0/2361018973 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f1142ffd640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114406a6e0 0x7f114409ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 -- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114406a6e0 msgr2=0x7f114409ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114406a6e0 0x7f114409ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11437fe640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1144144100 0x7f114409e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 -- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1144144100 msgr2=0x7f114409e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1144144100 0x7f114409e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 -- 172.21.15.167:0/2361018973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380094d0 con 0x7f114409a4f0 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f1142ffd640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114406a6e0 0x7f114409ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11427fc640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f114409a4f0 0x7f114409dc80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11380ae040 tx=0x7f11380191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380b6620 con 0x7f114409a4f0 2024-09-13T17:25:00.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380b6780 con 0x7f114409a4f0 2024-09-13T17:25:00.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114406a190 con 0x7f114409a4f0 2024-09-13T17:25:00.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380b6b30 con 0x7f114409a4f0 2024-09-13T17:25:00.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114409b6b0 con 0x7f114409a4f0 2024-09-13T17:25:00.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11440b45a0 con 0x7f114409a4f0 2024-09-13T17:25:00.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11380b2040 con 0x7f114409a4f0 2024-09-13T17:25:00.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1130066690 0x7f1130068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f113811eda0 con 0x7f114409a4f0 2024-09-13T17:25:00.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f1142ffd640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1130066690 0x7f1130068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7f113006fff0 0x7f1130072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 --> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1130072b60 con 0x7f113006fff0 2024-09-13T17:25:00.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.502+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f113811f1f0 con 0x7f114409a4f0 2024-09-13T17:25:00.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.506+0000 7f1142ffd640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1130066690 0x7f1130068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1134009840 tx=0x7f1134008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.506+0000 7f11437fe640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7f113006fff0 0x7f1130072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.506+0000 7f11437fe640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7f113006fff0 0x7f1130072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.506+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== osd.4 v2:172.21.15.190:6811/2201043679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1130072b60 con 0x7f113006fff0 2024-09-13T17:25:00.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.518+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 --> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f114409b3d0 con 0x7f113006fff0 2024-09-13T17:25:00.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f112b7fe640 1 -- 172.21.15.167:0/2361018973 <== osd.4 v2:172.21.15.190:6811/2201043679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f114409b3d0 con 0x7f113006fff0 2024-09-13T17:25:00.524 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:25:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:25:00.524 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7f113006fff0 msgr2=0x7f1130072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.190:6811/2201043679,v1:172.21.15.190:6813/2201043679] conn(0x7f113006fff0 0x7f1130072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1130066690 msgr2=0x7f1130068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f1130066690 0x7f1130068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1134009840 tx=0x7f1134008040 comp rx=0 tx=0).stop 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f114409a4f0 msgr2=0x7f114409dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 --2- 172.21.15.167:0/2361018973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f114409a4f0 0x7f114409dc80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11380ae040 tx=0x7f11380191f0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11437fe640 1 -- 172.21.15.167:0/2361018973 reap_dead start 2024-09-13T17:25:00.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 shutdown_connections 2024-09-13T17:25:00.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 >> 172.21.15.167:0/2361018973 conn(0x7f11440b4db0 msgr2=0x7f1144143080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 shutdown_connections 2024-09-13T17:25:00.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.522+0000 7f11493d9640 1 -- 172.21.15.167:0/2361018973 wait complete. 2024-09-13T17:25:00.540 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T17:25:00.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c55963640 1 Processor -- start 2024-09-13T17:25:00.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c55963640 1 -- start start 2024-09-13T17:25:00.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c55963640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c5006a1e0 0x7f4c5009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c55963640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c5009c600 0x7f4c5006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c55963640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500b5ea0 con 0x7f4c5006c940 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c55963640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5009b950 con 0x7f4c5009c600 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c55963640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5006aa60 con 0x7f4c5006a1e0 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4e7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c5009c600 0x7f4c5006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4c5006c940 0x7f4c50146f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47492/0 (socket says 172.21.15.167:47492) 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4f7fe640 1 -- 172.21.15.167:0/1055233950 learned_addr learned my addr 172.21.15.167:0/1055233950 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4e7fc640 1 -- 172.21.15.167:0/1055233950 >> v2:172.21.15.190:3300/0 conn(0x7f4c5006a1e0 msgr2=0x7f4c5009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4effd640 1 --2- 172.21.15.167:0/1055233950 >> v2:172.21.15.190:3300/0 conn(0x7f4c5006a1e0 0x7f4c5009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4dffb640 1 -- 172.21.15.167:0/1055233950 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237608540 0 0) 0x7f4c500b5ea0 con 0x7f4c5006c940 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4e7fc640 1 --2- 172.21.15.167:0/1055233950 >> v2:172.21.15.190:3300/0 conn(0x7f4c5006a1e0 0x7f4c5009c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4e7fc640 1 -- 172.21.15.167:0/1055233950 >> v1:172.21.15.167:6789/0 conn(0x7f4c5006c940 legacy=0x7f4c50146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4e7fc640 1 -- 172.21.15.167:0/1055233950 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500b60f0 con 0x7f4c5009c600 2024-09-13T17:25:00.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4e7fc640 1 --2- 172.21.15.167:0/1055233950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5009c600 0x7f4c5006c400 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4c500af300 tx=0x7f4c4401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2771eb16323ae21e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4dffb640 1 -- 172.21.15.167:0/1055233950 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c440ac640 con 0x7f4c5009c600 2024-09-13T17:25:00.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4dffb640 1 -- 172.21.15.167:0/1055233950 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c440ac7a0 con 0x7f4c5009c600 2024-09-13T17:25:00.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.642+0000 7f4c4dffb640 1 -- 172.21.15.167:0/1055233950 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c440acb30 con 0x7f4c5009c600 2024-09-13T17:25:00.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/1055233950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5009c600 msgr2=0x7f4c5006c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 --2- 172.21.15.167:0/1055233950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5009c600 0x7f4c5006c400 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4c500af300 tx=0x7f4c4401c3c0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/1055233950 shutdown_connections 2024-09-13T17:25:00.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 --2- 172.21.15.167:0/1055233950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5009c600 0x7f4c5006c400 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 --2- 172.21.15.167:0/1055233950 >> v2:172.21.15.190:3300/0 conn(0x7f4c5006a1e0 0x7f4c5009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/1055233950 >> 172.21.15.167:0/1055233950 conn(0x7f4c5006b9d0 msgr2=0x7f4c500b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/1055233950 shutdown_connections 2024-09-13T17:25:00.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/1055233950 wait complete. 2024-09-13T17:25:00.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 Processor -- start 2024-09-13T17:25:00.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- start start 2024-09-13T17:25:00.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5006a1e0 0x7f4c501e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5006c940 0x7f4c50135520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5009c600 0x7f4c50135a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50134460 con 0x7f4c5006a1e0 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50136e30 con 0x7f4c5006c940 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501e1d10 con 0x7f4c5009c600 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5006a1e0 0x7f4c501e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5006a1e0 0x7f4c501e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58286/0 (socket says 172.21.15.167:58286) 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 -- 172.21.15.167:0/4252961845 learned_addr learned my addr 172.21.15.167:0/4252961845 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4e7fc640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5006c940 0x7f4c50135520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4f7fe640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5009c600 0x7f4c50135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 -- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5009c600 msgr2=0x7f4c50135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5009c600 0x7f4c50135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 -- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5006c940 msgr2=0x7f4c50135520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5006c940 0x7f4c50135520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 -- 172.21.15.167:0/4252961845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44009420 con 0x7f4c5006a1e0 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c4effd640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5006a1e0 0x7f4c501e21a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800c820 tx=0x7f4c4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c37fff640 1 -- 172.21.15.167:0/4252961845 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48004220 con 0x7f4c5006a1e0 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c37fff640 1 -- 172.21.15.167:0/4252961845 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480043a0 con 0x7f4c5006a1e0 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c501e19c0 con 0x7f4c5006a1e0 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c37fff640 1 -- 172.21.15.167:0/4252961845 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48004510 con 0x7f4c5006a1e0 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c50137080 con 0x7f4c5006a1e0 2024-09-13T17:25:00.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.646+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5009b440 con 0x7f4c5006a1e0 2024-09-13T17:25:00.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.650+0000 7f4c37fff640 1 -- 172.21.15.167:0/4252961845 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c48007a70 con 0x7f4c5006a1e0 2024-09-13T17:25:00.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.650+0000 7f4c37fff640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4c3c066690 0x7f4c3c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.650+0000 7f4c37fff640 1 -- 172.21.15.167:0/4252961845 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4c480842d0 con 0x7f4c5006a1e0 2024-09-13T17:25:00.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.650+0000 7f4c4e7fc640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4c3c066690 0x7f4c3c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.650+0000 7f4c4e7fc640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4c3c066690 0x7f4c3c068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c440ae000 tx=0x7f4c44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.654+0000 7f4c37fff640 1 -- 172.21.15.167:0/4252961845 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c480512f0 con 0x7f4c5006a1e0 2024-09-13T17:25:00.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c5009c010 con 0x7f4c3c066690 2024-09-13T17:25:00.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c37fff640 1 -- 172.21.15.167:0/4252961845 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4c5009c010 con 0x7f4c3c066690 2024-09-13T17:25:00.805 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4c3c066690 msgr2=0x7f4c3c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4c3c066690 0x7f4c3c068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c440ae000 tx=0x7f4c44008040 comp rx=0 tx=0).stop 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5006a1e0 msgr2=0x7f4c501e21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5006a1e0 0x7f4c501e21a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800c820 tx=0x7f4c4800cce0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 shutdown_connections 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4c3c066690 0x7f4c3c068b50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5009c600 0x7f4c50135a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5006c940 0x7f4c50135520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 --2- 172.21.15.167:0/4252961845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c5006a1e0 0x7f4c501e21a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 >> 172.21.15.167:0/4252961845 conn(0x7f4c5006b9d0 msgr2=0x7f4c500b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 shutdown_connections 2024-09-13T17:25:00.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.802+0000 7f4c55963640 1 -- 172.21.15.167:0/4252961845 wait complete. 2024-09-13T17:25:00.822 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T17:25:00.822 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:25:00.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f308a4fc640 1 Processor -- start 2024-09-13T17:25:00.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f308a4fc640 1 -- start start 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f308a4fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f308409a650 0x7f3084145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f308a4fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f308406a830 0x7f3084150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f308a4fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308406a3a0 con 0x7f30840bada0 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f308a4fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30840b6c40 con 0x7f308409a650 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f308a4fc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3084145fd0 con 0x7f308406a830 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f30837fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f308409a650 0x7f3084145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f30837fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f308409a650 0x7f3084145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58294/0 (socket says 172.21.15.167:58294) 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f30837fe640 1 -- 172.21.15.167:0/3454671935 learned_addr learned my addr 172.21.15.167:0/3454671935 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f30837fe640 1 -- 172.21.15.167:0/3454671935 >> v2:172.21.15.190:3300/0 conn(0x7f308406a830 msgr2=0x7f3084150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f30837fe640 1 --2- 172.21.15.167:0/3454671935 >> v2:172.21.15.190:3300/0 conn(0x7f308406a830 0x7f3084150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f30837fe640 1 -- 172.21.15.167:0/3454671935 >> v1:172.21.15.190:6789/0 conn(0x7f30840bada0 legacy=0x7f3084099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:00.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.938+0000 7f30837fe640 1 -- 172.21.15.167:0/3454671935 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840bb180 con 0x7f308409a650 2024-09-13T17:25:00.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f30837fe640 1 --2- 172.21.15.167:0/3454671935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308409a650 0x7f3084145a90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f30840baad0 tx=0x7f307801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2869b8b7c815f84b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3082ffd640 1 -- 172.21.15.167:0/3454671935 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780ab670 con 0x7f308409a650 2024-09-13T17:25:00.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3082ffd640 1 -- 172.21.15.167:0/3454671935 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780ab7d0 con 0x7f308409a650 2024-09-13T17:25:00.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3082ffd640 1 -- 172.21.15.167:0/3454671935 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780abb60 con 0x7f308409a650 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- 172.21.15.167:0/3454671935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308409a650 msgr2=0x7f3084145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 --2- 172.21.15.167:0/3454671935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308409a650 0x7f3084145a90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f30840baad0 tx=0x7f307801c450 comp rx=0 tx=0).stop 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- 172.21.15.167:0/3454671935 shutdown_connections 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 --2- 172.21.15.167:0/3454671935 >> v2:172.21.15.190:3300/0 conn(0x7f308406a830 0x7f3084150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 --2- 172.21.15.167:0/3454671935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308409a650 0x7f3084145a90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- 172.21.15.167:0/3454671935 >> 172.21.15.167:0/3454671935 conn(0x7f30840b7e40 msgr2=0x7f30840b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- 172.21.15.167:0/3454671935 shutdown_connections 2024-09-13T17:25:00.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- 172.21.15.167:0/3454671935 wait complete. 2024-09-13T17:25:00.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 Processor -- start 2024-09-13T17:25:00.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- start start 2024-09-13T17:25:00.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308406a830 0x7f30840b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30840bada0 0x7f308413f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30840b1710 0x7f308413fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3084142d70 con 0x7f308406a830 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30840b4220 con 0x7f30840b1710 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30840b1ce0 con 0x7f30840bada0 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308406a830 0x7f30840b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308406a830 0x7f30840b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58304/0 (socket says 172.21.15.167:58304) 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 -- 172.21.15.167:0/1028583067 learned_addr learned my addr 172.21.15.167:0/1028583067 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3088a99640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30840b1710 0x7f308413fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f30837fe640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30840bada0 0x7f308413f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 -- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30840bada0 msgr2=0x7f308413f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30840bada0 0x7f308413f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 -- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30840b1710 msgr2=0x7f308413fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30840b1710 0x7f308413fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 -- 172.21.15.167:0/1028583067 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780094d0 con 0x7f308406a830 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3088a99640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30840b1710 0x7f308413fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3083fff640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308406a830 0x7f30840b4c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f307400b3e0 tx=0x7f307400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074011830 con 0x7f308406a830 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30740119b0 con 0x7f308406a830 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30841429a0 con 0x7f308406a830 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074011d60 con 0x7f308406a830 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.942+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30840b3e60 con 0x7f308406a830 2024-09-13T17:25:00.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30840b1b60 con 0x7f308406a830 2024-09-13T17:25:00.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f307401a400 con 0x7f308406a830 2024-09-13T17:25:00.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3080ff9640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3070066690 0x7f3070068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3074084660 con 0x7f308406a830 2024-09-13T17:25:00.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f30837fe640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3070066690 0x7f3070068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3080ff9640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f307006fff0 0x7f3070072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:00.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 --> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3070072b60 con 0x7f307006fff0 2024-09-13T17:25:00.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3074086d20 con 0x7f308406a830 2024-09-13T17:25:00.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f30837fe640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3070066690 0x7f3070068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30780af000 tx=0x7f3078008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3088a99640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f307006fff0 0x7f3070072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:00.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.946+0000 7f3088a99640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f307006fff0 0x7f3070072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:00.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.950+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== osd.5 v2:172.21.15.190:6824/362265715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3070072b60 con 0x7f307006fff0 2024-09-13T17:25:00.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 --> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f30841530e0 con 0x7f307006fff0 2024-09-13T17:25:00.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f3080ff9640 1 -- 172.21.15.167:0/1028583067 <== osd.5 v2:172.21.15.190:6824/362265715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f307c00e440 con 0x7f307006fff0 2024-09-13T17:25:00.964 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:25:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:25:00.965 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f307006fff0 msgr2=0x7f3070072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.190:6824/362265715,v1:172.21.15.190:6825/362265715] conn(0x7f307006fff0 0x7f3070072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3070066690 msgr2=0x7f3070068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3070066690 0x7f3070068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30780af000 tx=0x7f3078008040 comp rx=0 tx=0).stop 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308406a830 msgr2=0x7f30840b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 --2- 172.21.15.167:0/1028583067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f308406a830 0x7f30840b4c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f307400b3e0 tx=0x7f307400b8a0 comp rx=0 tx=0).stop 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f3088a99640 1 -- 172.21.15.167:0/1028583067 reap_dead start 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 shutdown_connections 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 >> 172.21.15.167:0/1028583067 conn(0x7f30840b7e40 msgr2=0x7f3084143a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 shutdown_connections 2024-09-13T17:25:00.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:00.962+0000 7f308a4fc640 1 -- 172.21.15.167:0/1028583067 wait complete. 2024-09-13T17:25:00.979 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T17:25:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a32397640 1 Processor -- start 2024-09-13T17:25:01.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a32397640 1 -- start start 2024-09-13T17:25:01.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a32397640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7a2c071880 0x7f7a2c142790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a32397640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0ae550 con 0x7f7a2c0ad3c0 2024-09-13T17:25:01.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a32397640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0ae1b0 con 0x7f7a2c142cd0 2024-09-13T17:25:01.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a32397640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c13cf80 con 0x7f7a2c071880 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7a2c0ad3c0 0x7f7a2c09a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47508/0 (socket says 172.21.15.167:47508) 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2bfff640 1 -- 172.21.15.167:0/59335991 learned_addr learned my addr 172.21.15.167:0/59335991 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2b7fe640 1 --2- 172.21.15.167:0/59335991 >> v2:172.21.15.190:3300/0 conn(0x7f7a2c071880 0x7f7a2c142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042003073 0 0) 0x7f7a2c0ae550 con 0x7f7a2c0ad3c0 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a14003530 con 0x7f7a2c0ad3c0 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 398811831 0 0) 0x7f7a14003530 con 0x7f7a2c0ad3c0 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 >> v2:172.21.15.190:3300/0 conn(0x7f7a2c071880 msgr2=0x7f7a2c142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 --2- 172.21.15.167:0/59335991 >> v2:172.21.15.190:3300/0 conn(0x7f7a2c071880 0x7f7a2c142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 >> v1:172.21.15.190:6789/0 conn(0x7f7a2c142cd0 legacy=0x7f7a2c14d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0adf10 con 0x7f7a2c0ad3c0 2024-09-13T17:25:01.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f7a1c001680 con 0x7f7a2c0ad3c0 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2b7fe640 1 --2- 172.21.15.167:0/59335991 >> v2:172.21.15.190:3300/0 conn(0x7f7a2c071880 0x7f7a2c142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 >> v1:172.21.15.167:6789/0 conn(0x7f7a2c0ad3c0 legacy=0x7f7a2c09a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14003980 0x7f7a14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a140047d0 0x7f7a14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a14005390 0x7f7a1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c13cf80 con 0x7f7a14005390 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1400c220 con 0x7f7a14003980 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1400c3e0 con 0x7f7a140047d0 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a30934640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a14005390 0x7f7a1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2bfff640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14003980 0x7f7a14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2b7fe640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a140047d0 0x7f7a14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a30934640 1 -- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a140047d0 msgr2=0x7f7a14004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:01.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a30934640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a140047d0 0x7f7a14004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a30934640 1 -- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14003980 msgr2=0x7f7a14003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:01.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a30934640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14003980 0x7f7a14003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a30934640 1 -- 172.21.15.167:0/59335991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14003530 con 0x7f7a14005390 2024-09-13T17:25:01.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.078+0000 7f7a2b7fe640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a140047d0 0x7f7a14004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:01.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a30934640 1 -- 172.21.15.167:0/59335991 reap_dead start 2024-09-13T17:25:01.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a30934640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a14005390 0x7f7a1400b990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7a24001a50 tx=0x7f7a2401e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab63f20fafe8cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24003b80 con 0x7f7a14005390 2024-09-13T17:25:01.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24003d00 con 0x7f7a14005390 2024-09-13T17:25:01.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2affd640 1 -- 172.21.15.167:0/59335991 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24005310 con 0x7f7a14005390 2024-09-13T17:25:01.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- 172.21.15.167:0/59335991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a14005390 msgr2=0x7f7a1400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a14005390 0x7f7a1400b990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7a24001a50 tx=0x7f7a2401e9b0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- 172.21.15.167:0/59335991 shutdown_connections 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 --2- 172.21.15.167:0/59335991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a14005390 0x7f7a1400b990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- 172.21.15.167:0/59335991 >> 172.21.15.167:0/59335991 conn(0x7f7a2c0b4c40 msgr2=0x7f7a2c0b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- 172.21.15.167:0/59335991 shutdown_connections 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- 172.21.15.167:0/59335991 wait complete. 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 Processor -- start 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- start start 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14005390 0x7f7a2c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a2c1d95b0 0x7f7a2c1d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a2c09d6c0 0x7f7a2c09db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b14f0 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1d9f50 con 0x7f7a14005390 2024-09-13T17:25:01.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a32397640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b0450 con 0x7f7a2c09d6c0 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a2c1d95b0 0x7f7a2c1d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a2c1d95b0 0x7f7a2c1d9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58326/0 (socket says 172.21.15.167:58326) 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 -- 172.21.15.167:0/40463063 learned_addr learned my addr 172.21.15.167:0/40463063 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2bfff640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14005390 0x7f7a2c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a30934640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a2c09d6c0 0x7f7a2c09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 -- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a2c09d6c0 msgr2=0x7f7a2c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a2c09d6c0 0x7f7a2c09db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 -- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14005390 msgr2=0x7f7a2c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14005390 0x7f7a2c0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 -- 172.21.15.167:0/40463063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0b0bc0 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a30934640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a2c09d6c0 0x7f7a2c09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.082+0000 7f7a2b7fe640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a2c1d95b0 0x7f7a2c1d9a10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e630 tx=0x7f7a2000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a28ff9640 1 -- 172.21.15.167:0/40463063 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20013610 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a28ff9640 1 -- 172.21.15.167:0/40463063 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20013770 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c0b0ea0 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a28ff9640 1 -- 172.21.15.167:0/40463063 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20013ae0 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c0af500 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c142790 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a28ff9640 1 -- 172.21.15.167:0/40463063 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a20013c40 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a28ff9640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a18066690 0x7f7a18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a2bfff640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a18066690 0x7f7a18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a28ff9640 1 -- 172.21.15.167:0/40463063 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7a20084390 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.086+0000 7f7a2bfff640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a18066690 0x7f7a18068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c001210 tx=0x7f7a1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.090+0000 7f7a28ff9640 1 -- 172.21.15.167:0/40463063 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a20051290 con 0x7f7a2c1d95b0 2024-09-13T17:25:01.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a2c0ae9c0 con 0x7f7a18066690 2024-09-13T17:25:01.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a28ff9640 1 -- 172.21.15.167:0/40463063 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7a1c001560 con 0x7f7a18066690 2024-09-13T17:25:01.241 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T17:25:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a18066690 msgr2=0x7f7a18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a18066690 0x7f7a18068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c001210 tx=0x7f7a1c009040 comp rx=0 tx=0).stop 2024-09-13T17:25:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a2c1d95b0 msgr2=0x7f7a2c1d9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a2c1d95b0 0x7f7a2c1d9a10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e630 tx=0x7f7a2000eaf0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 shutdown_connections 2024-09-13T17:25:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f7a18066690 0x7f7a18068b50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a2c09d6c0 0x7f7a2c09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a2c1d95b0 0x7f7a2c1d9a10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 --2- 172.21.15.167:0/40463063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a14005390 0x7f7a2c0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 >> 172.21.15.167:0/40463063 conn(0x7f7a2c0b4c40 msgr2=0x7f7a2c141e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 shutdown_connections 2024-09-13T17:25:01.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.238+0000 7f7a32397640 1 -- 172.21.15.167:0/40463063 wait complete. 2024-09-13T17:25:01.259 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T17:25:01.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:25:01.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bf862640 1 Processor -- start 2024-09-13T17:25:01.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bf862640 1 -- start start 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bf862640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b806f4f0 0x7f71b80b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bf862640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71b813f520 0x7f71b814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bf862640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b806edb0 con 0x7f71b80717d0 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bf862640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80710d0 con 0x7f71b813f520 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bf862640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b813f930 con 0x7f71b806f4f0 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bcdfd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f71b80717d0 0x7f71b813ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47522/0 (socket says 172.21.15.167:47522) 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bcdfd640 1 -- 172.21.15.167:0/1858485361 learned_addr learned my addr 172.21.15.167:0/1858485361 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bddff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71b813f520 0x7f71b814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bd5fe640 1 --2- 172.21.15.167:0/1858485361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b806f4f0 0x7f71b80b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bddff640 1 -- 172.21.15.167:0/1858485361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b806f4f0 msgr2=0x7f71b80b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:01.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bddff640 1 --2- 172.21.15.167:0/1858485361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b806f4f0 0x7f71b80b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bddff640 1 -- 172.21.15.167:0/1858485361 >> v1:172.21.15.167:6789/0 conn(0x7f71b80717d0 legacy=0x7f71b813ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71b7fff640 1 -- 172.21.15.167:0/1858485361 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688858303 0 0) 0x7f71b806edb0 con 0x7f71b80717d0 2024-09-13T17:25:01.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.378+0000 7f71bddff640 1 -- 172.21.15.167:0/1858485361 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b806f8d0 con 0x7f71b813f520 2024-09-13T17:25:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bddff640 1 --2- 172.21.15.167:0/1858485361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b813f520 0x7f71b814c6d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097c0 tx=0x7f71b001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f864f33a75a90f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71b7fff640 1 -- 172.21.15.167:0/1858485361 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a8990 con 0x7f71b813f520 2024-09-13T17:25:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71b7fff640 1 -- 172.21.15.167:0/1858485361 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00a8af0 con 0x7f71b813f520 2024-09-13T17:25:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71b7fff640 1 -- 172.21.15.167:0/1858485361 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a8e80 con 0x7f71b813f520 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- 172.21.15.167:0/1858485361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b813f520 msgr2=0x7f71b814c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 --2- 172.21.15.167:0/1858485361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b813f520 0x7f71b814c6d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097c0 tx=0x7f71b001ec90 comp rx=0 tx=0).stop 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- 172.21.15.167:0/1858485361 shutdown_connections 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 --2- 172.21.15.167:0/1858485361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b813f520 0x7f71b814c6d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 --2- 172.21.15.167:0/1858485361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b806f4f0 0x7f71b80b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- 172.21.15.167:0/1858485361 >> 172.21.15.167:0/1858485361 conn(0x7f71b8069f80 msgr2=0x7f71b806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- 172.21.15.167:0/1858485361 shutdown_connections 2024-09-13T17:25:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- 172.21.15.167:0/1858485361 wait complete. 2024-09-13T17:25:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 Processor -- start 2024-09-13T17:25:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- start start 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b806f4f0 0x7f71b80b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b80717d0 0x7f71b81dbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b813f520 0x7f71b8145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81db3e0 con 0x7f71b806f4f0 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8138810 con 0x7f71b80717d0 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.382+0000 7f71bf862640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81dc300 con 0x7f71b813f520 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b806f4f0 0x7f71b80b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b806f4f0 0x7f71b80b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58348/0 (socket says 172.21.15.167:58348) 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 -- 172.21.15.167:0/1511657525 learned_addr learned my addr 172.21.15.167:0/1511657525 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bcdfd640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b80717d0 0x7f71b81dbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bddff640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b813f520 0x7f71b8145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 -- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b813f520 msgr2=0x7f71b8145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b813f520 0x7f71b8145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 -- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b80717d0 msgr2=0x7f71b81dbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b80717d0 0x7f71b81dbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 -- 172.21.15.167:0/1511657525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009420 con 0x7f71b806f4f0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bd5fe640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b806f4f0 0x7f71b80b1720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f71a800d830 tx=0x7f71a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800b660 con 0x7f71b806f4f0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800b7c0 con 0x7f71b806f4f0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b80ae870 con 0x7f71b806f4f0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800bb30 con 0x7f71b806f4f0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b8138a10 con 0x7f71b806f4f0 2024-09-13T17:25:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71b806fcb0 con 0x7f71b806f4f0 2024-09-13T17:25:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71a801e460 con 0x7f71b806f4f0 2024-09-13T17:25:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a4066690 0x7f71a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f71a8085670 con 0x7f71b806f4f0 2024-09-13T17:25:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bcdfd640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a4066690 0x7f71a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f71a406fff0 0x7f71a4072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 --> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71a4072b60 con 0x7f71a406fff0 2024-09-13T17:25:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a8085ac0 con 0x7f71b806f4f0 2024-09-13T17:25:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bcdfd640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a4066690 0x7f71a4068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007fd0 tx=0x7f71ac007ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.386+0000 7f71bddff640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f71a406fff0 0x7f71a4072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.390+0000 7f71bddff640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f71a406fff0 0x7f71a4072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.390+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== osd.6 v2:172.21.15.190:6808/2566293699 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f71a4072b60 con 0x7f71a406fff0 2024-09-13T17:25:01.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 --> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71b806ff90 con 0x7f71a406fff0 2024-09-13T17:25:01.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71b5ffb640 1 -- 172.21.15.167:0/1511657525 <== osd.6 v2:172.21.15.190:6808/2566293699 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f71b00a8970 con 0x7f71a406fff0 2024-09-13T17:25:01.407 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:25:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:25:01.407 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f71a406fff0 msgr2=0x7f71a4072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.190:6808/2566293699,v1:172.21.15.190:6809/2566293699] conn(0x7f71a406fff0 0x7f71a4072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a4066690 msgr2=0x7f71a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a4066690 0x7f71a4068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007fd0 tx=0x7f71ac007ee0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b806f4f0 msgr2=0x7f71b80b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 --2- 172.21.15.167:0/1511657525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b806f4f0 0x7f71b80b1720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f71a800d830 tx=0x7f71a800dcf0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bddff640 1 -- 172.21.15.167:0/1511657525 reap_dead start 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 shutdown_connections 2024-09-13T17:25:01.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 >> 172.21.15.167:0/1511657525 conn(0x7f71b8069f80 msgr2=0x7f71b813d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 shutdown_connections 2024-09-13T17:25:01.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.402+0000 7f71bf862640 1 -- 172.21.15.167:0/1511657525 wait complete. 2024-09-13T17:25:01.424 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T17:25:01.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549ed7f640 1 Processor -- start 2024-09-13T17:25:01.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549ed7f640 1 -- start start 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549ed7f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5498098a40 0x7f5498143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549ed7f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5498144490 con 0x7f54980b3530 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549ed7f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549809d410 con 0x7f5498143fe0 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549ed7f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549809b090 con 0x7f5498098a40 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f5497fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5498098a40 0x7f5498143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549cb1b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f54980b3530 0x7f549809cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47536/0 (socket says 172.21.15.167:47536) 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f549cb1b640 1 -- 172.21.15.167:0/2018088801 learned_addr learned my addr 172.21.15.167:0/2018088801 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f5497fff640 1 -- 172.21.15.167:0/2018088801 >> v1:172.21.15.190:6789/0 conn(0x7f5498143fe0 legacy=0x7f549814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f5497fff640 1 -- 172.21.15.167:0/2018088801 >> v1:172.21.15.167:6789/0 conn(0x7f54980b3530 legacy=0x7f549809cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f5497fff640 1 -- 172.21.15.167:0/2018088801 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980b3910 con 0x7f5498098a40 2024-09-13T17:25:01.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f54977fe640 1 -- 172.21.15.167:0/2018088801 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493220374 0 0) 0x7f5498144490 con 0x7f54980b3530 2024-09-13T17:25:01.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f5497fff640 1 --2- 172.21.15.167:0/2018088801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5498098a40 0x7f5498143aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f54840097c0 tx=0x7f548401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfba3b59b83707df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f54977fe640 1 -- 172.21.15.167:0/2018088801 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840ab660 con 0x7f5498098a40 2024-09-13T17:25:01.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f54977fe640 1 -- 172.21.15.167:0/2018088801 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54840ab7c0 con 0x7f5498098a40 2024-09-13T17:25:01.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.538+0000 7f54977fe640 1 -- 172.21.15.167:0/2018088801 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840abb50 con 0x7f5498098a40 2024-09-13T17:25:01.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2018088801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5498098a40 msgr2=0x7f5498143aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2018088801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5498098a40 0x7f5498143aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f54840097c0 tx=0x7f548401c460 comp rx=0 tx=0).stop 2024-09-13T17:25:01.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2018088801 shutdown_connections 2024-09-13T17:25:01.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2018088801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5498098a40 0x7f5498143aa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2018088801 >> 172.21.15.167:0/2018088801 conn(0x7f54980b3b50 msgr2=0x7f54980b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2018088801 shutdown_connections 2024-09-13T17:25:01.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2018088801 wait complete. 2024-09-13T17:25:01.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 Processor -- start 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- start start 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54980b3530 0x7f5498140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5498143fe0 0x7f54981e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54980ade80 0x7f54981e16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980ac3a0 con 0x7f54980ade80 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980ac680 con 0x7f5498143fe0 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54980ac960 con 0x7f54980b3530 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54980ade80 0x7f54981e16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54980ade80 0x7f54981e16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58358/0 (socket says 172.21.15.167:58358) 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 -- 172.21.15.167:0/2500017500 learned_addr learned my addr 172.21.15.167:0/2500017500 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 -- 172.21.15.167:0/2500017500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54980b3530 msgr2=0x7f5498140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f5497fff640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5498143fe0 0x7f54981e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54980b3530 0x7f5498140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 -- 172.21.15.167:0/2500017500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5498143fe0 msgr2=0x7f54981e11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5498143fe0 0x7f54981e11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 -- 172.21.15.167:0/2500017500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009420 con 0x7f54980ade80 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549d31c640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54980ade80 0x7f54981e16f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f549000b970 tx=0x7f549000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f54957fa640 1 -- 172.21.15.167:0/2500017500 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000cb40 con 0x7f54980ade80 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f54957fa640 1 -- 172.21.15.167:0/2500017500 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000cca0 con 0x7f54980ade80 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5498140f10 con 0x7f54980ade80 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f54957fa640 1 -- 172.21.15.167:0/2500017500 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490014680 con 0x7f54980ade80 2024-09-13T17:25:01.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54980713a0 con 0x7f54980ade80 2024-09-13T17:25:01.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.542+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5498071650 con 0x7f54980ade80 2024-09-13T17:25:01.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.546+0000 7f54957fa640 1 -- 172.21.15.167:0/2500017500 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f549001c360 con 0x7f54980ade80 2024-09-13T17:25:01.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.546+0000 7f54957fa640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f547c066690 0x7f547c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.546+0000 7f54957fa640 1 -- 172.21.15.167:0/2500017500 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5490084520 con 0x7f54980ade80 2024-09-13T17:25:01.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.546+0000 7f549cb1b640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f547c066690 0x7f547c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.546+0000 7f549cb1b640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f547c066690 0x7f547c068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f548c0011f0 tx=0x7f548c007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.550+0000 7f54957fa640 1 -- 172.21.15.167:0/2500017500 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5490051420 con 0x7f54980ade80 2024-09-13T17:25:01.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5498099c20 con 0x7f547c066690 2024-09-13T17:25:01.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f54957fa640 1 -- 172.21.15.167:0/2500017500 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f548c0070d0 con 0x7f547c066690 2024-09-13T17:25:01.713 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T17:25:01.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f547c066690 msgr2=0x7f547c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f547c066690 0x7f547c068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f548c0011f0 tx=0x7f548c007930 comp rx=0 tx=0).stop 2024-09-13T17:25:01.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54980ade80 msgr2=0x7f54981e16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54980ade80 0x7f54981e16f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f549000b970 tx=0x7f549000be30 comp rx=0 tx=0).stop 2024-09-13T17:25:01.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 shutdown_connections 2024-09-13T17:25:01.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f547c066690 0x7f547c068b50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54980ade80 0x7f54981e16f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5498143fe0 0x7f54981e11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 --2- 172.21.15.167:0/2500017500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54980b3530 0x7f5498140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 >> 172.21.15.167:0/2500017500 conn(0x7f54980b3b50 msgr2=0x7f549806b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 shutdown_connections 2024-09-13T17:25:01.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.710+0000 7f549ed7f640 1 -- 172.21.15.167:0/2500017500 wait complete. 2024-09-13T17:25:01.732 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T17:25:01.732 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:25:01.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d24d87640 1 Processor -- start 2024-09-13T17:25:01.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d24d87640 1 -- start start 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d24d87640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d200992d0 0x7f6d200ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d24d87640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d200996b0 0x7f6d20142660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d24d87640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d20143050 con 0x7f6d20142ba0 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d24d87640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d200b34c0 con 0x7f6d200992d0 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d24d87640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200ae2a0 con 0x7f6d200996b0 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d200992d0 0x7f6d200ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1ed9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6d20142ba0 0x7f6d20145600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47552/0 (socket says 172.21.15.167:47552) 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1ed9d640 1 -- 172.21.15.167:0/3193871146 learned_addr learned my addr 172.21.15.167:0/3193871146 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1d59a640 1 -- 172.21.15.167:0/3193871146 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27451171 0 0) 0x7f6d180014a0 con 0x7f6d20142ba0 2024-09-13T17:25:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1dd9b640 1 --2- 172.21.15.167:0/3193871146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d200996b0 0x7f6d20142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1d59a640 1 -- 172.21.15.167:0/3193871146 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d08003530 con 0x7f6d20142ba0 2024-09-13T17:25:01.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1e59c640 1 -- 172.21.15.167:0/3193871146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d200996b0 msgr2=0x7f6d20142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:01.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1e59c640 1 --2- 172.21.15.167:0/3193871146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d200996b0 0x7f6d20142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1e59c640 1 -- 172.21.15.167:0/3193871146 >> v1:172.21.15.167:6789/0 conn(0x7f6d20142ba0 legacy=0x7f6d20145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.850+0000 7f6d1e59c640 1 -- 172.21.15.167:0/3193871146 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200ad4e0 con 0x7f6d200992d0 2024-09-13T17:25:01.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 --2- 172.21.15.167:0/3193871146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d200ac300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a960 tx=0x7f6d1001d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab2821ef030cd2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1d59a640 1 -- 172.21.15.167:0/3193871146 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a67e0 con 0x7f6d200992d0 2024-09-13T17:25:01.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1d59a640 1 -- 172.21.15.167:0/3193871146 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d100a6940 con 0x7f6d200992d0 2024-09-13T17:25:01.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1d59a640 1 -- 172.21.15.167:0/3193871146 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a6cb0 con 0x7f6d200992d0 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- 172.21.15.167:0/3193871146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 msgr2=0x7f6d200ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 --2- 172.21.15.167:0/3193871146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d200ac300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a960 tx=0x7f6d1001d7b0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- 172.21.15.167:0/3193871146 shutdown_connections 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 --2- 172.21.15.167:0/3193871146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d200996b0 0x7f6d20142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 --2- 172.21.15.167:0/3193871146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d200ac300 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- 172.21.15.167:0/3193871146 >> 172.21.15.167:0/3193871146 conn(0x7f6d200b3b50 msgr2=0x7f6d200b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- 172.21.15.167:0/3193871146 shutdown_connections 2024-09-13T17:25:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- 172.21.15.167:0/3193871146 wait complete. 2024-09-13T17:25:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 Processor -- start 2024-09-13T17:25:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- start start 2024-09-13T17:25:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d2014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d200996b0 0x7f6d2013a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d20142ba0 0x7f6d2013ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2014d350 con 0x7f6d200992d0 2024-09-13T17:25:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200715b0 con 0x7f6d200996b0 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2014ca20 con 0x7f6d20142ba0 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d2014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d2014ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58378/0 (socket says 172.21.15.167:58378) 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 -- 172.21.15.167:0/1668995535 learned_addr learned my addr 172.21.15.167:0/1668995535 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1ed9d640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d20142ba0 0x7f6d2013ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 -- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d20142ba0 msgr2=0x7f6d2013ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d20142ba0 0x7f6d2013ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1dd9b640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d200996b0 0x7f6d2013a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 -- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d200996b0 msgr2=0x7f6d2013a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d200996b0 0x7f6d2013a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 -- 172.21.15.167:0/1668995535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1000a5c0 con 0x7f6d200992d0 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d1e59c640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d2014ad40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c10 tx=0x7f6d1001a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10004450 con 0x7f6d200992d0 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d100a6760 con 0x7f6d200992d0 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2014cd00 con 0x7f6d200992d0 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10003820 con 0x7f6d200992d0 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.854+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2014c590 con 0x7f6d200992d0 2024-09-13T17:25:01.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d200adf30 con 0x7f6d200992d0 2024-09-13T17:25:01.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d100b5040 con 0x7f6d200992d0 2024-09-13T17:25:01.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d0effd640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6d000666c0 0x7f6d00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6d1011edf0 con 0x7f6d200992d0 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d1dd9b640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6d000666c0 0x7f6d00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d0effd640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f6d00070020 0x7f6d000724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 --> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d00072b90 con 0x7f6d00070020 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d1011f240 con 0x7f6d200992d0 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d1dd9b640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6d000666c0 0x7f6d00068b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d2013b320 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d1ed9d640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f6d00070020 0x7f6d000724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.858+0000 7f6d1ed9d640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f6d00070020 0x7f6d000724c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.862+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== osd.7 v2:172.21.15.190:6800/1492320865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6d00072b90 con 0x7f6d00070020 2024-09-13T17:25:01.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 --> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d2014d490 con 0x7f6d00070020 2024-09-13T17:25:01.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d0effd640 1 -- 172.21.15.167:0/1668995535 <== osd.7 v2:172.21.15.190:6800/1492320865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6d180070e0 con 0x7f6d00070020 2024-09-13T17:25:01.877 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-13T17:25:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:25:01.877 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-13T17:25:01.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f6d00070020 msgr2=0x7f6d000724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.190:6800/1492320865,v1:172.21.15.190:6801/1492320865] conn(0x7f6d00070020 0x7f6d000724c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6d000666c0 msgr2=0x7f6d00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6d000666c0 0x7f6d00068b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d2013b320 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 msgr2=0x7f6d2014ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 --2- 172.21.15.167:0/1668995535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d200992d0 0x7f6d2014ad40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c10 tx=0x7f6d1001a550 comp rx=0 tx=0).stop 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d1ed9d640 1 -- 172.21.15.167:0/1668995535 reap_dead start 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 shutdown_connections 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 >> 172.21.15.167:0/1668995535 conn(0x7f6d200b3b50 msgr2=0x7f6d2013d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 shutdown_connections 2024-09-13T17:25:01.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.874+0000 7f6d24d87640 1 -- 172.21.15.167:0/1668995535 wait complete. 2024-09-13T17:25:01.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T17:25:01.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd16665b640 1 Processor -- start 2024-09-13T17:25:01.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd16665b640 1 -- start start 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd16665b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1600bada0 0x7fd160145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd16665b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16006a3a0 con 0x7fd16006a830 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd16665b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd160145fd0 con 0x7fd16009a650 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd16665b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1600b6c40 con 0x7fd1600bada0 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd15f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd16006a830 0x7fd160099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47558/0 (socket says 172.21.15.167:47558) 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd15f7fe640 1 -- 172.21.15.167:0/4199071695 learned_addr learned my addr 172.21.15.167:0/4199071695 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.994+0000 7fd15ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1600bada0 0x7fd160145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15effd640 1 -- 172.21.15.167:0/4199071695 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742106421 0 0) 0x7fd16006a3a0 con 0x7fd16006a830 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15effd640 1 -- 172.21.15.167:0/4199071695 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd148003530 con 0x7fd16006a830 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15ffff640 1 -- 172.21.15.167:0/4199071695 >> v1:172.21.15.190:6789/0 conn(0x7fd16009a650 legacy=0x7fd160150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15ffff640 1 -- 172.21.15.167:0/4199071695 >> v1:172.21.15.167:6789/0 conn(0x7fd16006a830 legacy=0x7fd160099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15ffff640 1 -- 172.21.15.167:0/4199071695 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1600bb180 con 0x7fd1600bada0 2024-09-13T17:25:02.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15ffff640 1 --2- 172.21.15.167:0/4199071695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1600bada0 0x7fd160145a90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd150009d90 tx=0x7fd15001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0ea4e1109d991a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15effd640 1 -- 172.21.15.167:0/4199071695 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500a59c0 con 0x7fd1600bada0 2024-09-13T17:25:02.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15effd640 1 -- 172.21.15.167:0/4199071695 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1500a5b20 con 0x7fd1600bada0 2024-09-13T17:25:02.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd15effd640 1 -- 172.21.15.167:0/4199071695 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500ad440 con 0x7fd1600bada0 2024-09-13T17:25:02.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd16665b640 1 -- 172.21.15.167:0/4199071695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1600bada0 msgr2=0x7fd160145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd16665b640 1 --2- 172.21.15.167:0/4199071695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1600bada0 0x7fd160145a90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd150009d90 tx=0x7fd15001c8e0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd16665b640 1 -- 172.21.15.167:0/4199071695 shutdown_connections 2024-09-13T17:25:02.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd16665b640 1 --2- 172.21.15.167:0/4199071695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1600bada0 0x7fd160145a90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd16665b640 1 -- 172.21.15.167:0/4199071695 >> 172.21.15.167:0/4199071695 conn(0x7fd1600b7e40 msgr2=0x7fd1600b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:02.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd16665b640 1 -- 172.21.15.167:0/4199071695 shutdown_connections 2024-09-13T17:25:02.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:01.998+0000 7fd16665b640 1 -- 172.21.15.167:0/4199071695 wait complete. 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 Processor -- start 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 -- start start 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16006a830 0x7fd1600b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd160142170 0x7fd1600b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1600b1bb0 0x7fd1600b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1600b2fc0 con 0x7fd160142170 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1601425f0 con 0x7fd1600b1bb0 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1600b4290 con 0x7fd16006a830 2024-09-13T17:25:02.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd160142170 0x7fd1600b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd160142170 0x7fd1600b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58396/0 (socket says 172.21.15.167:58396) 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 -- 172.21.15.167:0/3823262242 learned_addr learned my addr 172.21.15.167:0/3823262242 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 -- 172.21.15.167:0/3823262242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16006a830 msgr2=0x7fd1600b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16006a830 0x7fd1600b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 -- 172.21.15.167:0/3823262242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1600b1bb0 msgr2=0x7fd1600b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1600b1bb0 0x7fd1600b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 -- 172.21.15.167:0/3823262242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150009a70 con 0x7fd160142170 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15f7fe640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd160142170 0x7fd1600b1670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c530 tx=0x7fd15400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15cff9640 1 -- 172.21.15.167:0/3823262242 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154005cf0 con 0x7fd160142170 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15cff9640 1 -- 172.21.15.167:0/3823262242 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd154005e50 con 0x7fd160142170 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1600b33e0 con 0x7fd160142170 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15cff9640 1 -- 172.21.15.167:0/3823262242 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154007270 con 0x7fd160142170 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1600b4500 con 0x7fd160142170 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1600b3230 con 0x7fd160142170 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15cff9640 1 -- 172.21.15.167:0/3823262242 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1540073d0 con 0x7fd160142170 2024-09-13T17:25:02.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.002+0000 7fd15cff9640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd14c066690 0x7fd14c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.006+0000 7fd15ffff640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd14c066690 0x7fd14c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.006+0000 7fd15cff9640 1 -- 172.21.15.167:0/3823262242 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd154083e60 con 0x7fd160142170 2024-09-13T17:25:02.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.006+0000 7fd15ffff640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd14c066690 0x7fd14c068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1500af000 tx=0x7fd150004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.006+0000 7fd15cff9640 1 -- 172.21.15.167:0/3823262242 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd1540afdb0 con 0x7fd160142170 2024-09-13T17:25:02.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.154+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1601546d0 con 0x7fd14c066690 2024-09-13T17:25:02.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.154+0000 7fd15cff9640 1 -- 172.21.15.167:0/3823262242 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd1500a5980 con 0x7fd14c066690 2024-09-13T17:25:02.158 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T17:25:02.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd14c066690 msgr2=0x7fd14c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd14c066690 0x7fd14c068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1500af000 tx=0x7fd150004ac0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd160142170 msgr2=0x7fd1600b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd160142170 0x7fd1600b1670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c530 tx=0x7fd15400c9f0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 shutdown_connections 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fd14c066690 0x7fd14c068b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1600b1bb0 0x7fd1600b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd160142170 0x7fd1600b1670 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 --2- 172.21.15.167:0/3823262242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd16006a830 0x7fd1600b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 >> 172.21.15.167:0/3823262242 conn(0x7fd1600b7e40 msgr2=0x7fd160144b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 shutdown_connections 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.158+0000 7fd16665b640 1 -- 172.21.15.167:0/3823262242 wait complete. 2024-09-13T17:25:02.176 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:25:02.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.290+0000 7f71b994b640 1 Processor -- start 2024-09-13T17:25:02.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.290+0000 7f71b994b640 1 -- start start 2024-09-13T17:25:02.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71b414d160 0x7f71b414f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b4071b10 con 0x7f71b40b0960 2024-09-13T17:25:02.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b4071df0 con 0x7f71b406f0f0 2024-09-13T17:25:02.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b406f7f0 con 0x7f71b414d160 2024-09-13T17:25:02.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71b414d160 0x7f71b414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b27fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f71b40b0960 0x7f71b413d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47570/0 (socket says 172.21.15.167:47570) 2024-09-13T17:25:02.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b27fc640 1 -- 172.21.15.167:0/3230638906 learned_addr learned my addr 172.21.15.167:0/3230638906 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:02.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b37fe640 1 -- 172.21.15.167:0/3230638906 >> v1:172.21.15.190:6789/0 conn(0x7f71b406f0f0 legacy=0x7f71b4070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:02.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b37fe640 1 -- 172.21.15.167:0/3230638906 >> v1:172.21.15.167:6789/0 conn(0x7f71b40b0960 legacy=0x7f71b413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b37fe640 1 -- 172.21.15.167:0/3230638906 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b406f4d0 con 0x7f71b414d160 2024-09-13T17:25:02.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b1ffb640 1 -- 172.21.15.167:0/3230638906 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483540377 0 0) 0x7f71b4071b10 con 0x7f71b40b0960 2024-09-13T17:25:02.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b37fe640 1 --2- 172.21.15.167:0/3230638906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414d160 0x7f71b414f550 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009d90 tx=0x7f71ac01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f247923ca8a2aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b1ffb640 1 -- 172.21.15.167:0/3230638906 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a57c0 con 0x7f71b414d160 2024-09-13T17:25:02.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b1ffb640 1 -- 172.21.15.167:0/3230638906 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac0a5920 con 0x7f71b414d160 2024-09-13T17:25:02.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b1ffb640 1 -- 172.21.15.167:0/3230638906 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a5cb0 con 0x7f71b414d160 2024-09-13T17:25:02.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- 172.21.15.167:0/3230638906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414d160 msgr2=0x7f71b414f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 --2- 172.21.15.167:0/3230638906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414d160 0x7f71b414f550 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009d90 tx=0x7f71ac01c810 comp rx=0 tx=0).stop 2024-09-13T17:25:02.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- 172.21.15.167:0/3230638906 shutdown_connections 2024-09-13T17:25:02.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 --2- 172.21.15.167:0/3230638906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414d160 0x7f71b414f550 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- 172.21.15.167:0/3230638906 >> 172.21.15.167:0/3230638906 conn(0x7f71b40b7250 msgr2=0x7f71b40b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:02.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- 172.21.15.167:0/3230638906 shutdown_connections 2024-09-13T17:25:02.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.294+0000 7f71b994b640 1 -- 172.21.15.167:0/3230638906 wait complete. 2024-09-13T17:25:02.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 Processor -- start 2024-09-13T17:25:02.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 -- start start 2024-09-13T17:25:02.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b406f0f0 0x7f71b4135f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b40b0960 0x7f71b4141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b414d160 0x7f71b41424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4144870 con 0x7f71b406f0f0 2024-09-13T17:25:02.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b413b0c0 con 0x7f71b414d160 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41445d0 con 0x7f71b40b0960 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b406f0f0 0x7f71b4135f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b406f0f0 0x7f71b4135f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58410/0 (socket says 172.21.15.167:58410) 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 -- 172.21.15.167:0/2474504864 learned_addr learned my addr 172.21.15.167:0/2474504864 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 -- 172.21.15.167:0/2474504864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b40b0960 msgr2=0x7f71b4141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b37fe640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b414d160 0x7f71b41424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b40b0960 0x7f71b4141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 -- 172.21.15.167:0/2474504864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b414d160 msgr2=0x7f71b41424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b414d160 0x7f71b41424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 -- 172.21.15.167:0/2474504864 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009a70 con 0x7f71b406f0f0 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b2ffd640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b406f0f0 0x7f71b4135f80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f71a400b3e0 tx=0x7f71a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f719bfff640 1 -- 172.21.15.167:0/2474504864 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4011830 con 0x7f71b406f0f0 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f719bfff640 1 -- 172.21.15.167:0/2474504864 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a40119b0 con 0x7f71b406f0f0 2024-09-13T17:25:02.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b4072400 con 0x7f71b406f0f0 2024-09-13T17:25:02.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f719bfff640 1 -- 172.21.15.167:0/2474504864 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4011d60 con 0x7f71b406f0f0 2024-09-13T17:25:02.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4142250 con 0x7f71b406f0f0 2024-09-13T17:25:02.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b4072260 con 0x7f71b406f0f0 2024-09-13T17:25:02.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.298+0000 7f719bfff640 1 -- 172.21.15.167:0/2474504864 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71a401a400 con 0x7f71b406f0f0 2024-09-13T17:25:02.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.302+0000 7f719bfff640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a0066690 0x7f71a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.302+0000 7f719bfff640 1 -- 172.21.15.167:0/2474504864 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f71a4084620 con 0x7f71b406f0f0 2024-09-13T17:25:02.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.302+0000 7f71b27fc640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a0066690 0x7f71a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.302+0000 7f71b27fc640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a0066690 0x7f71a0068b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f71a80011f0 tx=0x7f71a8007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.306+0000 7f719bfff640 1 -- 172.21.15.167:0/2474504864 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71b4072260 con 0x7f71b406f0f0 2024-09-13T17:25:02.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.462+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71b40b0d40 con 0x7f71a0066690 2024-09-13T17:25:02.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.490+0000 7f719bfff640 1 -- 172.21.15.167:0/2474504864 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368273 (secure 0 0 0) 0x7f71b40b0d40 con 0x7f71a0066690 2024-09-13T17:25:02.497 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:25:02.499 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a0066690 msgr2=0x7f71a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a0066690 0x7f71a0068b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f71a80011f0 tx=0x7f71a8007930 comp rx=0 tx=0).stop 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b406f0f0 msgr2=0x7f71b4135f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b406f0f0 0x7f71b4135f80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f71a400b3e0 tx=0x7f71a400b8a0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 shutdown_connections 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f71a0066690 0x7f71a0068b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b414d160 0x7f71b41424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71b40b0960 0x7f71b4141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 --2- 172.21.15.167:0/2474504864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b406f0f0 0x7f71b4135f80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 >> 172.21.15.167:0/2474504864 conn(0x7f71b40b7250 msgr2=0x7f71b413be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 shutdown_connections 2024-09-13T17:25:02.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:02.494+0000 7f71b994b640 1 -- 172.21.15.167:0/2474504864 wait complete. 2024-09-13T17:25:02.518 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-13T17:25:01.577695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1415264,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":122,"num_write":314,"num_write_kb":3304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225456,"kb_used_data":5232,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749264,"statfs":{"total":773094113280,"available":772863246336,"internally_reserved":0,"allocated":5357568,"data_stored":3823560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":225431098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":61,"apply_latency_ms":61,"commit_latency_ns":61000000,"apply_latency_ns":61000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29600,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":19,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003913"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712812+0000","last_change":"2024-09-13T17:20:50.592271+0000","last_active":"2024-09-13T17:21:32.712812+0000","last_peered":"2024-09-13T17:21:32.712812+0000","last_clean":"2024-09-13T17:21:32.712812+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:21:32.712812+0000","last_undegraded":"2024-09-13T17:21:32.712812+0000","last_fullsized":"2024-09-13T17:21:32.712812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.761427+0000","last_change":"2024-09-13T17:20:50.974266+0000","last_active":"2024-09-13T17:24:55.761427+0000","last_peered":"2024-09-13T17:24:55.761427+0000","last_clean":"2024-09-13T17:24:55.761427+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:24:55.761427+0000","last_undegraded":"2024-09-13T17:24:55.761427+0000","last_fullsized":"2024-09-13T17:24:55.761427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709835+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:21:32.709835+0000","last_peered":"2024-09-13T17:21:32.709835+0000","last_clean":"2024-09-13T17:21:32.709835+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:21:32.709835+0000","last_undegraded":"2024-09-13T17:21:32.709835+0000","last_fullsized":"2024-09-13T17:21:32.709835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.549774+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:22:53.549774+0000","last_peered":"2024-09-13T17:22:53.549774+0000","last_clean":"2024-09-13T17:22:53.549774+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:22:53.549774+0000","last_undegraded":"2024-09-13T17:22:53.549774+0000","last_fullsized":"2024-09-13T17:22:53.549774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.791936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'8","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.747494+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:24:55.747494+0000","last_peered":"2024-09-13T17:24:55.747494+0000","last_clean":"2024-09-13T17:24:55.747494+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:24:55.747494+0000","last_undegraded":"2024-09-13T17:24:55.747494+0000","last_fullsized":"2024-09-13T17:24:55.747494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715058+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:21:32.715058+0000","last_peered":"2024-09-13T17:21:32.715058+0000","last_clean":"2024-09-13T17:21:32.715058+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:21:32.715058+0000","last_undegraded":"2024-09-13T17:21:32.715058+0000","last_fullsized":"2024-09-13T17:21:32.715058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.030817+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:22:41.030817+0000","last_peered":"2024-09-13T17:22:41.030817+0000","last_clean":"2024-09-13T17:22:41.030817+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:22:41.030817+0000","last_undegraded":"2024-09-13T17:22:41.030817+0000","last_fullsized":"2024-09-13T17:22:41.030817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'8","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.776955+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:24:55.776955+0000","last_peered":"2024-09-13T17:24:55.776955+0000","last_clean":"2024-09-13T17:24:55.776955+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:24:55.776955+0000","last_undegraded":"2024-09-13T17:24:55.776955+0000","last_fullsized":"2024-09-13T17:24:55.776955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715545+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:21:32.715545+0000","last_peered":"2024-09-13T17:21:32.715545+0000","last_clean":"2024-09-13T17:21:32.715545+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:21:32.715545+0000","last_undegraded":"2024-09-13T17:21:32.715545+0000","last_fullsized":"2024-09-13T17:21:32.715545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:47.608296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.557212+0000","last_change":"2024-09-13T17:20:50.614418+0000","last_active":"2024-09-13T17:23:23.557212+0000","last_peered":"2024-09-13T17:23:23.557212+0000","last_clean":"2024-09-13T17:23:23.557212+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:23:23.557212+0000","last_undegraded":"2024-09-13T17:23:23.557212+0000","last_fullsized":"2024-09-13T17:23:23.557212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'14","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.777024+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:24:55.777024+0000","last_peered":"2024-09-13T17:24:55.777024+0000","last_clean":"2024-09-13T17:24:55.777024+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:24:55.777024+0000","last_undegraded":"2024-09-13T17:24:55.777024+0000","last_fullsized":"2024-09-13T17:24:55.777024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715495+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:21:32.715495+0000","last_peered":"2024-09-13T17:21:32.715495+0000","last_clean":"2024-09-13T17:21:32.715495+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:21:32.715495+0000","last_undegraded":"2024-09-13T17:21:32.715495+0000","last_fullsized":"2024-09-13T17:21:32.715495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:16.837028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.767106+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:24:55.767106+0000","last_peered":"2024-09-13T17:24:55.767106+0000","last_clean":"2024-09-13T17:24:55.767106+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:24:55.767106+0000","last_undegraded":"2024-09-13T17:24:55.767106+0000","last_fullsized":"2024-09-13T17:24:55.767106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.044555+0000","last_change":"2024-09-13T17:20:50.614791+0000","last_active":"2024-09-13T17:22:51.044555+0000","last_peered":"2024-09-13T17:22:51.044555+0000","last_clean":"2024-09-13T17:22:51.044555+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:22:51.044555+0000","last_undegraded":"2024-09-13T17:22:51.044555+0000","last_fullsized":"2024-09-13T17:22:51.044555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.716876+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:21:32.716876+0000","last_peered":"2024-09-13T17:21:32.716876+0000","last_clean":"2024-09-13T17:21:32.716876+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:21:32.716876+0000","last_undegraded":"2024-09-13T17:21:32.716876+0000","last_fullsized":"2024-09-13T17:21:32.716876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'9","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.747959+0000","last_change":"2024-09-13T17:20:50.952295+0000","last_active":"2024-09-13T17:24:55.747959+0000","last_peered":"2024-09-13T17:24:55.747959+0000","last_clean":"2024-09-13T17:24:55.747959+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:24:55.747959+0000","last_undegraded":"2024-09-13T17:24:55.747959+0000","last_fullsized":"2024-09-13T17:24:55.747959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780740+0000","last_change":"2024-09-13T17:20:50.585647+0000","last_active":"2024-09-13T17:21:32.780740+0000","last_peered":"2024-09-13T17:21:32.780740+0000","last_clean":"2024-09-13T17:21:32.780740+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:21:32.780740+0000","last_undegraded":"2024-09-13T17:21:32.780740+0000","last_fullsized":"2024-09-13T17:21:32.780740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717428+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:21:32.717428+0000","last_peered":"2024-09-13T17:21:32.717428+0000","last_clean":"2024-09-13T17:21:32.717428+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:21:32.717428+0000","last_undegraded":"2024-09-13T17:21:32.717428+0000","last_fullsized":"2024-09-13T17:21:32.717428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.712488+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:24:55.712488+0000","last_peered":"2024-09-13T17:24:55.712488+0000","last_clean":"2024-09-13T17:24:55.712488+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:24:55.712488+0000","last_undegraded":"2024-09-13T17:24:55.712488+0000","last_fullsized":"2024-09-13T17:24:55.712488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.041977+0000","last_change":"2024-09-13T17:20:50.592525+0000","last_active":"2024-09-13T17:22:51.041977+0000","last_peered":"2024-09-13T17:22:51.041977+0000","last_clean":"2024-09-13T17:22:51.041977+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:22:51.041977+0000","last_undegraded":"2024-09-13T17:22:51.041977+0000","last_fullsized":"2024-09-13T17:22:51.041977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781403+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:21:32.781403+0000","last_peered":"2024-09-13T17:21:32.781403+0000","last_clean":"2024-09-13T17:21:32.781403+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:21:32.781403+0000","last_undegraded":"2024-09-13T17:21:32.781403+0000","last_fullsized":"2024-09-13T17:21:32.781403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.766219+0000","last_change":"2024-09-13T17:20:50.974294+0000","last_active":"2024-09-13T17:24:55.766219+0000","last_peered":"2024-09-13T17:24:55.766219+0000","last_clean":"2024-09-13T17:24:55.766219+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:24:55.766219+0000","last_undegraded":"2024-09-13T17:24:55.766219+0000","last_fullsized":"2024-09-13T17:24:55.766219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.537392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043779+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:22:51.043779+0000","last_peered":"2024-09-13T17:22:51.043779+0000","last_clean":"2024-09-13T17:22:51.043779+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:22:51.043779+0000","last_undegraded":"2024-09-13T17:22:51.043779+0000","last_fullsized":"2024-09-13T17:22:51.043779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.377950+0000","last_change":"2024-09-13T17:21:33.376826+0000","last_active":"2024-09-13T17:21:33.377950+0000","last_peered":"2024-09-13T17:21:33.377950+0000","last_clean":"2024-09-13T17:21:33.377950+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:21:33.377950+0000","last_undegraded":"2024-09-13T17:21:33.377950+0000","last_fullsized":"2024-09-13T17:21:33.377950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:39.885449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.745797+0000","last_change":"2024-09-13T17:20:50.945803+0000","last_active":"2024-09-13T17:24:55.745797+0000","last_peered":"2024-09-13T17:24:55.745797+0000","last_clean":"2024-09-13T17:24:55.745797+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:24:55.745797+0000","last_undegraded":"2024-09-13T17:24:55.745797+0000","last_fullsized":"2024-09-13T17:24:55.745797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047002+0000","last_change":"2024-09-13T17:20:50.611813+0000","last_active":"2024-09-13T17:22:51.047002+0000","last_peered":"2024-09-13T17:22:51.047002+0000","last_clean":"2024-09-13T17:22:51.047002+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:22:51.047002+0000","last_undegraded":"2024-09-13T17:22:51.047002+0000","last_fullsized":"2024-09-13T17:22:51.047002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715303+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:21:32.715303+0000","last_peered":"2024-09-13T17:21:32.715303+0000","last_clean":"2024-09-13T17:21:32.715303+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:21:32.715303+0000","last_undegraded":"2024-09-13T17:21:32.715303+0000","last_fullsized":"2024-09-13T17:21:32.715303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.776774+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:24:55.776774+0000","last_peered":"2024-09-13T17:24:55.776774+0000","last_clean":"2024-09-13T17:24:55.776774+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:24:55.776774+0000","last_undegraded":"2024-09-13T17:24:55.776774+0000","last_fullsized":"2024-09-13T17:24:55.776774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'22","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:52.122770+0000","last_change":"2024-09-13T17:20:50.601801+0000","last_active":"2024-09-13T17:24:52.122770+0000","last_peered":"2024-09-13T17:24:52.122770+0000","last_clean":"2024-09-13T17:24:52.122770+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:24:52.122770+0000","last_undegraded":"2024-09-13T17:24:52.122770+0000","last_fullsized":"2024-09-13T17:24:52.122770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.550648+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:22:58.550648+0000","last_peered":"2024-09-13T17:22:58.550648+0000","last_clean":"2024-09-13T17:22:58.550648+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:22:58.550648+0000","last_undegraded":"2024-09-13T17:22:58.550648+0000","last_fullsized":"2024-09-13T17:22:58.550648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:47.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.740359+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:24:55.740359+0000","last_peered":"2024-09-13T17:24:55.740359+0000","last_clean":"2024-09-13T17:24:55.740359+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:24:55.740359+0000","last_undegraded":"2024-09-13T17:24:55.740359+0000","last_fullsized":"2024-09-13T17:24:55.740359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.031459+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:22:41.031459+0000","last_peered":"2024-09-13T17:22:41.031459+0000","last_clean":"2024-09-13T17:22:41.031459+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:22:41.031459+0000","last_undegraded":"2024-09-13T17:22:41.031459+0000","last_fullsized":"2024-09-13T17:22:41.031459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:50.928673+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:23:50.928673+0000","last_peered":"2024-09-13T17:23:50.928673+0000","last_clean":"2024-09-13T17:23:50.928673+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:23:50.928673+0000","last_undegraded":"2024-09-13T17:23:50.928673+0000","last_fullsized":"2024-09-13T17:23:50.928673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:59.623952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'6","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.772993+0000","last_change":"2024-09-13T17:21:32.783988+0000","last_active":"2024-09-13T17:24:55.772993+0000","last_peered":"2024-09-13T17:24:55.772993+0000","last_clean":"2024-09-13T17:24:55.772993+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:24:55.772993+0000","last_undegraded":"2024-09-13T17:24:55.772993+0000","last_fullsized":"2024-09-13T17:24:55.772993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:39.042962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780985+0000","last_change":"2024-09-13T17:20:50.576119+0000","last_active":"2024-09-13T17:21:32.780985+0000","last_peered":"2024-09-13T17:21:32.780985+0000","last_clean":"2024-09-13T17:21:32.780985+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:21:32.780985+0000","last_undegraded":"2024-09-13T17:21:32.780985+0000","last_fullsized":"2024-09-13T17:21:32.780985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780248+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:21:32.780248+0000","last_peered":"2024-09-13T17:21:32.780248+0000","last_clean":"2024-09-13T17:21:32.780248+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:21:32.780248+0000","last_undegraded":"2024-09-13T17:21:32.780248+0000","last_fullsized":"2024-09-13T17:21:32.780248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:27.796797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.724521+0000","last_change":"2024-09-13T17:20:50.974241+0000","last_active":"2024-09-13T17:24:55.724521+0000","last_peered":"2024-09-13T17:24:55.724521+0000","last_clean":"2024-09-13T17:24:55.724521+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:24:55.724521+0000","last_undegraded":"2024-09-13T17:24:55.724521+0000","last_fullsized":"2024-09-13T17:24:55.724521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:38.448481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.034077+0000","last_change":"2024-09-13T17:20:50.595726+0000","last_active":"2024-09-13T17:22:46.034077+0000","last_peered":"2024-09-13T17:22:46.034077+0000","last_clean":"2024-09-13T17:22:46.034077+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:22:46.034077+0000","last_undegraded":"2024-09-13T17:22:46.034077+0000","last_fullsized":"2024-09-13T17:22:46.034077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:50.314123+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:24:50.314123+0000","last_peered":"2024-09-13T17:24:50.314123+0000","last_clean":"2024-09-13T17:24:50.314123+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:24:50.314123+0000","last_undegraded":"2024-09-13T17:24:50.314123+0000","last_fullsized":"2024-09-13T17:24:50.314123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:46.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.747848+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:24:55.747848+0000","last_peered":"2024-09-13T17:24:55.747848+0000","last_clean":"2024-09-13T17:24:55.747848+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:24:55.747848+0000","last_undegraded":"2024-09-13T17:24:55.747848+0000","last_fullsized":"2024-09-13T17:24:55.747848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'21","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.905297+0000","last_change":"2024-09-13T17:20:50.586533+0000","last_active":"2024-09-13T17:24:59.905297+0000","last_peered":"2024-09-13T17:24:59.905297+0000","last_clean":"2024-09-13T17:24:59.905297+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:24:59.905297+0000","last_undegraded":"2024-09-13T17:24:59.905297+0000","last_fullsized":"2024-09-13T17:24:59.905297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":15,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.781623+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:21:32.781623+0000","last_peered":"2024-09-13T17:21:32.781623+0000","last_clean":"2024-09-13T17:21:32.781623+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:21:32.781623+0000","last_undegraded":"2024-09-13T17:21:32.781623+0000","last_fullsized":"2024-09-13T17:21:32.781623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.760704+0000","last_change":"2024-09-13T17:20:50.974601+0000","last_active":"2024-09-13T17:24:55.760704+0000","last_peered":"2024-09-13T17:24:55.760704+0000","last_clean":"2024-09-13T17:24:55.760704+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:24:55.760704+0000","last_undegraded":"2024-09-13T17:24:55.760704+0000","last_fullsized":"2024-09-13T17:24:55.760704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:48.453962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:53.550732+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:22:53.550732+0000","last_peered":"2024-09-13T17:22:53.550732+0000","last_clean":"2024-09-13T17:22:53.550732+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:22:53.550732+0000","last_undegraded":"2024-09-13T17:22:53.550732+0000","last_fullsized":"2024-09-13T17:22:53.550732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:23.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.206492+0000","last_change":"2024-09-13T17:21:33.205535+0000","last_active":"2024-09-13T17:21:33.206492+0000","last_peered":"2024-09-13T17:21:33.206492+0000","last_clean":"2024-09-13T17:21:33.206492+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:21:33.206492+0000","last_undegraded":"2024-09-13T17:21:33.206492+0000","last_fullsized":"2024-09-13T17:21:33.206492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:01.951295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.711462+0000","last_change":"2024-09-13T17:21:32.786124+0000","last_active":"2024-09-13T17:24:55.711462+0000","last_peered":"2024-09-13T17:24:55.711462+0000","last_clean":"2024-09-13T17:24:55.711462+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:24:55.711462+0000","last_undegraded":"2024-09-13T17:24:55.711462+0000","last_fullsized":"2024-09-13T17:24:55.711462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:04.040678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043912+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:22:51.043912+0000","last_peered":"2024-09-13T17:22:51.043912+0000","last_clean":"2024-09-13T17:22:51.043912+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:22:51.043912+0000","last_undegraded":"2024-09-13T17:22:51.043912+0000","last_fullsized":"2024-09-13T17:22:51.043912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:26.585045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:43.548854+0000","last_change":"2024-09-13T17:20:41.457672+0000","last_active":"2024-09-13T17:22:43.548854+0000","last_peered":"2024-09-13T17:22:43.548854+0000","last_clean":"2024-09-13T17:22:43.548854+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:22:43.548854+0000","last_undegraded":"2024-09-13T17:22:43.548854+0000","last_fullsized":"2024-09-13T17:22:43.548854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:40.345043+0000","last_clean_scrub_stamp":"2024-09-13T17:20:40.345043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:04.605423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373613+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:21:33.373613+0000","last_peered":"2024-09-13T17:21:33.373613+0000","last_clean":"2024-09-13T17:21:33.373613+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:21:33.373613+0000","last_undegraded":"2024-09-13T17:21:33.373613+0000","last_fullsized":"2024-09-13T17:21:33.373613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:21.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.767648+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:24:55.767648+0000","last_peered":"2024-09-13T17:24:55.767648+0000","last_clean":"2024-09-13T17:24:55.767648+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:24:55.767648+0000","last_undegraded":"2024-09-13T17:24:55.767648+0000","last_fullsized":"2024-09-13T17:24:55.767648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:11.382071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:52.122879+0000","last_change":"2024-09-13T17:20:50.603532+0000","last_active":"2024-09-13T17:24:52.122879+0000","last_peered":"2024-09-13T17:24:52.122879+0000","last_clean":"2024-09-13T17:24:52.122879+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:24:52.122879+0000","last_undegraded":"2024-09-13T17:24:52.122879+0000","last_fullsized":"2024-09-13T17:24:52.122879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.373267+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:21:33.373267+0000","last_peered":"2024-09-13T17:21:33.373267+0000","last_clean":"2024-09-13T17:21:33.373267+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:21:33.373267+0000","last_undegraded":"2024-09-13T17:21:33.373267+0000","last_fullsized":"2024-09-13T17:21:33.373267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.183271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.763338+0000","last_change":"2024-09-13T17:20:50.971485+0000","last_active":"2024-09-13T17:24:55.763338+0000","last_peered":"2024-09-13T17:24:55.763338+0000","last_clean":"2024-09-13T17:24:55.763338+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:24:55.763338+0000","last_undegraded":"2024-09-13T17:24:55.763338+0000","last_fullsized":"2024-09-13T17:24:55.763338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.042941+0000","last_change":"2024-09-13T17:20:50.596608+0000","last_active":"2024-09-13T17:22:51.042941+0000","last_peered":"2024-09-13T17:22:51.042941+0000","last_clean":"2024-09-13T17:22:51.042941+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:22:51.042941+0000","last_undegraded":"2024-09-13T17:22:51.042941+0000","last_fullsized":"2024-09-13T17:22:51.042941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.163068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.712372+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:21:32.712372+0000","last_peered":"2024-09-13T17:21:32.712372+0000","last_clean":"2024-09-13T17:21:32.712372+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:21:32.712372+0000","last_undegraded":"2024-09-13T17:21:32.712372+0000","last_fullsized":"2024-09-13T17:21:32.712372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:18.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780477+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:24:55.780477+0000","last_peered":"2024-09-13T17:24:55.780477+0000","last_clean":"2024-09-13T17:24:55.780477+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:24:55.780477+0000","last_undegraded":"2024-09-13T17:24:55.780477+0000","last_fullsized":"2024-09-13T17:24:55.780477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:06.533058+0000","last_change":"2024-09-13T17:20:50.587186+0000","last_active":"2024-09-13T17:23:06.533058+0000","last_peered":"2024-09-13T17:23:06.533058+0000","last_clean":"2024-09-13T17:23:06.533058+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:23:06.533058+0000","last_undegraded":"2024-09-13T17:23:06.533058+0000","last_fullsized":"2024-09-13T17:23:06.533058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.717513+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:21:32.717513+0000","last_peered":"2024-09-13T17:21:32.717513+0000","last_clean":"2024-09-13T17:21:32.717513+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:21:32.717513+0000","last_undegraded":"2024-09-13T17:21:32.717513+0000","last_fullsized":"2024-09-13T17:21:32.717513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'6","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.760961+0000","last_change":"2024-09-13T17:21:32.725077+0000","last_active":"2024-09-13T17:24:55.760961+0000","last_peered":"2024-09-13T17:24:55.760961+0000","last_clean":"2024-09-13T17:24:55.760961+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:24:55.760961+0000","last_undegraded":"2024-09-13T17:24:55.760961+0000","last_fullsized":"2024-09-13T17:24:55.760961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.043971+0000","last_change":"2024-09-13T17:20:50.587372+0000","last_active":"2024-09-13T17:22:51.043971+0000","last_peered":"2024-09-13T17:22:51.043971+0000","last_clean":"2024-09-13T17:22:51.043971+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:22:51.043971+0000","last_undegraded":"2024-09-13T17:22:51.043971+0000","last_fullsized":"2024-09-13T17:22:51.043971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:15.561228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715050+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:21:32.715050+0000","last_peered":"2024-09-13T17:21:32.715050+0000","last_clean":"2024-09-13T17:21:32.715050+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:21:32.715050+0000","last_undegraded":"2024-09-13T17:21:32.715050+0000","last_fullsized":"2024-09-13T17:21:32.715050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:10.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.768729+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:24:55.768729+0000","last_peered":"2024-09-13T17:24:55.768729+0000","last_clean":"2024-09-13T17:24:55.768729+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:24:55.768729+0000","last_undegraded":"2024-09-13T17:24:55.768729+0000","last_fullsized":"2024-09-13T17:24:55.768729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'12","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:56.122420+0000","last_change":"2024-09-13T17:20:50.582096+0000","last_active":"2024-09-13T17:24:56.122420+0000","last_peered":"2024-09-13T17:24:56.122420+0000","last_clean":"2024-09-13T17:24:56.122420+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:24:56.122420+0000","last_undegraded":"2024-09-13T17:24:56.122420+0000","last_fullsized":"2024-09-13T17:24:56.122420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.711905+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:21:32.711905+0000","last_peered":"2024-09-13T17:21:32.711905+0000","last_clean":"2024-09-13T17:21:32.711905+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:21:32.711905+0000","last_undegraded":"2024-09-13T17:21:32.711905+0000","last_fullsized":"2024-09-13T17:21:32.711905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:18.138571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.762477+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:24:55.762477+0000","last_peered":"2024-09-13T17:24:55.762477+0000","last_clean":"2024-09-13T17:24:55.762477+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:24:55.762477+0000","last_undegraded":"2024-09-13T17:24:55.762477+0000","last_fullsized":"2024-09-13T17:24:55.762477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.079825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047765+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:22:51.047765+0000","last_peered":"2024-09-13T17:22:51.047765+0000","last_clean":"2024-09-13T17:22:51.047765+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:22:51.047765+0000","last_undegraded":"2024-09-13T17:22:51.047765+0000","last_fullsized":"2024-09-13T17:22:51.047765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:49.528767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715067+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:21:32.715067+0000","last_peered":"2024-09-13T17:21:32.715067+0000","last_clean":"2024-09-13T17:21:32.715067+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:21:32.715067+0000","last_undegraded":"2024-09-13T17:21:32.715067+0000","last_fullsized":"2024-09-13T17:21:32.715067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:06.579554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'20","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778238+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:24:55.778238+0000","last_peered":"2024-09-13T17:24:55.778238+0000","last_clean":"2024-09-13T17:24:55.778238+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:24:55.778238+0000","last_undegraded":"2024-09-13T17:24:55.778238+0000","last_fullsized":"2024-09-13T17:24:55.778238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046511+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:22:51.046511+0000","last_peered":"2024-09-13T17:22:51.046511+0000","last_clean":"2024-09-13T17:22:51.046511+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:22:51.046511+0000","last_undegraded":"2024-09-13T17:22:51.046511+0000","last_fullsized":"2024-09-13T17:22:51.046511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.713774+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:21:32.713774+0000","last_peered":"2024-09-13T17:21:32.713774+0000","last_clean":"2024-09-13T17:21:32.713774+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:21:32.713774+0000","last_undegraded":"2024-09-13T17:21:32.713774+0000","last_fullsized":"2024-09-13T17:21:32.713774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.756233+0000","last_change":"2024-09-13T17:20:50.990538+0000","last_active":"2024-09-13T17:24:55.756233+0000","last_peered":"2024-09-13T17:24:55.756233+0000","last_clean":"2024-09-13T17:24:55.756233+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:24:55.756233+0000","last_undegraded":"2024-09-13T17:24:55.756233+0000","last_fullsized":"2024-09-13T17:24:55.756233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.028553+0000","last_change":"2024-09-13T17:20:50.597289+0000","last_active":"2024-09-13T17:22:41.028553+0000","last_peered":"2024-09-13T17:22:41.028553+0000","last_clean":"2024-09-13T17:22:41.028553+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:22:41.028553+0000","last_undegraded":"2024-09-13T17:22:41.028553+0000","last_fullsized":"2024-09-13T17:22:41.028553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.721562+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:21:32.721562+0000","last_peered":"2024-09-13T17:21:32.721562+0000","last_clean":"2024-09-13T17:21:32.721562+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:21:32.721562+0000","last_undegraded":"2024-09-13T17:21:32.721562+0000","last_fullsized":"2024-09-13T17:21:32.721562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.769358+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:24:55.769358+0000","last_peered":"2024-09-13T17:24:55.769358+0000","last_clean":"2024-09-13T17:24:55.769358+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:24:55.769358+0000","last_undegraded":"2024-09-13T17:24:55.769358+0000","last_fullsized":"2024-09-13T17:24:55.769358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'61","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.691237+0000","last_change":"2024-09-13T17:20:50.602398+0000","last_active":"2024-09-13T17:24:55.691237+0000","last_peered":"2024-09-13T17:24:55.691237+0000","last_clean":"2024-09-13T17:24:55.691237+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:24:55.691237+0000","last_undegraded":"2024-09-13T17:24:55.691237+0000","last_fullsized":"2024-09-13T17:24:55.691237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813073,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.780411+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:21:32.780411+0000","last_peered":"2024-09-13T17:21:32.780411+0000","last_clean":"2024-09-13T17:21:32.780411+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:21:32.780411+0000","last_undegraded":"2024-09-13T17:21:32.780411+0000","last_fullsized":"2024-09-13T17:21:32.780411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'12","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.781569+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:24:55.781569+0000","last_peered":"2024-09-13T17:24:55.781569+0000","last_clean":"2024-09-13T17:24:55.781569+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:24:55.781569+0000","last_undegraded":"2024-09-13T17:24:55.781569+0000","last_fullsized":"2024-09-13T17:24:55.781569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:46.171693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'15","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:52.127093+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:24:52.127093+0000","last_peered":"2024-09-13T17:24:52.127093+0000","last_clean":"2024-09-13T17:24:52.127093+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:24:52.127093+0000","last_undegraded":"2024-09-13T17:24:52.127093+0000","last_fullsized":"2024-09-13T17:24:52.127093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:24.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.715770+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:21:32.715770+0000","last_peered":"2024-09-13T17:21:32.715770+0000","last_clean":"2024-09-13T17:21:32.715770+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:21:32.715770+0000","last_undegraded":"2024-09-13T17:21:32.715770+0000","last_fullsized":"2024-09-13T17:21:32.715770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:32.740725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.775252+0000","last_change":"2024-09-13T17:21:32.722613+0000","last_active":"2024-09-13T17:24:55.775252+0000","last_peered":"2024-09-13T17:24:55.775252+0000","last_clean":"2024-09-13T17:24:55.775252+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:24:55.775252+0000","last_undegraded":"2024-09-13T17:24:55.775252+0000","last_fullsized":"2024-09-13T17:24:55.775252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.047585+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:22:51.047585+0000","last_peered":"2024-09-13T17:22:51.047585+0000","last_clean":"2024-09-13T17:22:51.047585+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:22:51.047585+0000","last_undegraded":"2024-09-13T17:22:51.047585+0000","last_fullsized":"2024-09-13T17:22:51.047585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.709825+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:21:32.709825+0000","last_peered":"2024-09-13T17:21:32.709825+0000","last_clean":"2024-09-13T17:21:32.709825+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:21:32.709825+0000","last_undegraded":"2024-09-13T17:21:32.709825+0000","last_fullsized":"2024-09-13T17:21:32.709825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:30.627485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780910+0000","last_change":"2024-09-13T17:20:50.996151+0000","last_active":"2024-09-13T17:24:55.780910+0000","last_peered":"2024-09-13T17:24:55.780910+0000","last_clean":"2024-09-13T17:24:55.780910+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:24:55.780910+0000","last_undegraded":"2024-09-13T17:24:55.780910+0000","last_fullsized":"2024-09-13T17:24:55.780910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046749+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:22:51.046749+0000","last_peered":"2024-09-13T17:22:51.046749+0000","last_clean":"2024-09-13T17:22:51.046749+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:22:51.046749+0000","last_undegraded":"2024-09-13T17:22:51.046749+0000","last_fullsized":"2024-09-13T17:22:51.046749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:53.093138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.710043+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:21:32.710043+0000","last_peered":"2024-09-13T17:21:32.710043+0000","last_clean":"2024-09-13T17:21:32.710043+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:21:32.710043+0000","last_undegraded":"2024-09-13T17:21:32.710043+0000","last_fullsized":"2024-09-13T17:21:32.710043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:33.043683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:58.543472+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:22:58.543472+0000","last_peered":"2024-09-13T17:22:58.543472+0000","last_clean":"2024-09-13T17:22:58.543472+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:22:58.543472+0000","last_undegraded":"2024-09-13T17:22:58.543472+0000","last_fullsized":"2024-09-13T17:22:58.543472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:15.147964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.745860+0000","last_change":"2024-09-13T17:20:50.942124+0000","last_active":"2024-09-13T17:24:55.745860+0000","last_peered":"2024-09-13T17:24:55.745860+0000","last_clean":"2024-09-13T17:24:55.745860+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:24:55.745860+0000","last_undegraded":"2024-09-13T17:24:55.745860+0000","last_fullsized":"2024-09-13T17:24:55.745860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:09.050505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046252+0000","last_change":"2024-09-13T17:20:50.603837+0000","last_active":"2024-09-13T17:22:51.046252+0000","last_peered":"2024-09-13T17:22:51.046252+0000","last_clean":"2024-09-13T17:22:51.046252+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:22:51.046252+0000","last_undegraded":"2024-09-13T17:22:51.046252+0000","last_fullsized":"2024-09-13T17:22:51.046252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:33.374293+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:21:33.374293+0000","last_peered":"2024-09-13T17:21:33.374293+0000","last_clean":"2024-09-13T17:21:33.374293+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:21:33.374293+0000","last_undegraded":"2024-09-13T17:21:33.374293+0000","last_fullsized":"2024-09-13T17:21:33.374293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.483518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.743105+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:24:55.743105+0000","last_peered":"2024-09-13T17:24:55.743105+0000","last_clean":"2024-09-13T17:24:55.743105+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:24:55.743105+0000","last_undegraded":"2024-09-13T17:24:55.743105+0000","last_fullsized":"2024-09-13T17:24:55.743105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:51.046569+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:22:51.046569+0000","last_peered":"2024-09-13T17:22:51.046569+0000","last_clean":"2024-09-13T17:22:51.046569+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:22:51.046569+0000","last_undegraded":"2024-09-13T17:22:51.046569+0000","last_fullsized":"2024-09-13T17:22:51.046569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:14.261845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:46.032396+0000","last_change":"2024-09-13T17:20:50.602904+0000","last_active":"2024-09-13T17:22:46.032396+0000","last_peered":"2024-09-13T17:22:46.032396+0000","last_clean":"2024-09-13T17:22:46.032396+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:22:46.032396+0000","last_undegraded":"2024-09-13T17:22:46.032396+0000","last_fullsized":"2024-09-13T17:22:46.032396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:33.590486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.760639+0000","last_change":"2024-09-13T17:20:50.976216+0000","last_active":"2024-09-13T17:24:55.760639+0000","last_peered":"2024-09-13T17:24:55.760639+0000","last_clean":"2024-09-13T17:24:55.760639+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:24:55.760639+0000","last_undegraded":"2024-09-13T17:24:55.760639+0000","last_fullsized":"2024-09-13T17:24:55.760639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:26.535789+0000","last_change":"2024-09-13T17:20:54.981746+0000","last_active":"2024-09-13T17:23:26.535789+0000","last_peered":"2024-09-13T17:23:26.535789+0000","last_clean":"2024-09-13T17:23:26.535789+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:23:26.535789+0000","last_undegraded":"2024-09-13T17:23:26.535789+0000","last_fullsized":"2024-09-13T17:23:26.535789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:22:41.027160+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:22:41.027160+0000","last_peered":"2024-09-13T17:22:41.027160+0000","last_clean":"2024-09-13T17:22:41.027160+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:22:41.027160+0000","last_undegraded":"2024-09-13T17:22:41.027160+0000","last_fullsized":"2024-09-13T17:22:41.027160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:04.074022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.761471+0000","last_change":"2024-09-13T17:20:50.974155+0000","last_active":"2024-09-13T17:24:55.761471+0000","last_peered":"2024-09-13T17:24:55.761471+0000","last_clean":"2024-09-13T17:24:55.761471+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:24:55.761471+0000","last_undegraded":"2024-09-13T17:24:55.761471+0000","last_fullsized":"2024-09-13T17:24:55.761471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.011082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:21:32.726286+0000","last_change":"2024-09-13T17:21:32.724190+0000","last_active":"2024-09-13T17:21:32.726286+0000","last_peered":"2024-09-13T17:21:32.726286+0000","last_clean":"2024-09-13T17:21:32.726286+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:21:32.726286+0000","last_undegraded":"2024-09-13T17:21:32.726286+0000","last_fullsized":"2024-09-13T17:21:32.726286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:48.005131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'8","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.760426+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:24:55.760426+0000","last_peered":"2024-09-13T17:24:55.760426+0000","last_clean":"2024-09-13T17:24:55.760426+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:24:55.760426+0000","last_undegraded":"2024-09-13T17:24:55.760426+0000","last_fullsized":"2024-09-13T17:24:55.760426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:22.288207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.905380+0000","last_change":"2024-09-13T17:20:50.968526+0000","last_active":"2024-09-13T17:24:59.905380+0000","last_peered":"2024-09-13T17:24:59.905380+0000","last_clean":"2024-09-13T17:24:59.905380+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:24:59.905380+0000","last_undegraded":"2024-09-13T17:24:59.905380+0000","last_fullsized":"2024-09-13T17:24:59.905380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.775443+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:24:55.775443+0000","last_peered":"2024-09-13T17:24:55.775443+0000","last_clean":"2024-09-13T17:24:55.775443+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:24:55.775443+0000","last_undegraded":"2024-09-13T17:24:55.775443+0000","last_fullsized":"2024-09-13T17:24:55.775443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:56.753182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.743489+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:24:55.743489+0000","last_peered":"2024-09-13T17:24:55.743489+0000","last_clean":"2024-09-13T17:24:55.743489+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:24:55.743489+0000","last_undegraded":"2024-09-13T17:24:55.743489+0000","last_fullsized":"2024-09-13T17:24:55.743489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.765759+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:24:55.765759+0000","last_peered":"2024-09-13T17:24:55.765759+0000","last_clean":"2024-09-13T17:24:55.765759+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:24:55.765759+0000","last_undegraded":"2024-09-13T17:24:55.765759+0000","last_fullsized":"2024-09-13T17:24:55.765759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.745982+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:24:55.745982+0000","last_peered":"2024-09-13T17:24:55.745982+0000","last_clean":"2024-09-13T17:24:55.745982+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:24:55.745982+0000","last_undegraded":"2024-09-13T17:24:55.745982+0000","last_fullsized":"2024-09-13T17:24:55.745982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'13","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778776+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:24:55.778776+0000","last_peered":"2024-09-13T17:24:55.778776+0000","last_clean":"2024-09-13T17:24:55.778776+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:24:55.778776+0000","last_undegraded":"2024-09-13T17:24:55.778776+0000","last_fullsized":"2024-09-13T17:24:55.778776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.765672+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:24:55.765672+0000","last_peered":"2024-09-13T17:24:55.765672+0000","last_clean":"2024-09-13T17:24:55.765672+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:24:55.765672+0000","last_undegraded":"2024-09-13T17:24:55.765672+0000","last_fullsized":"2024-09-13T17:24:55.765672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'9","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778078+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:24:55.778078+0000","last_peered":"2024-09-13T17:24:55.778078+0000","last_clean":"2024-09-13T17:24:55.778078+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:24:55.778078+0000","last_undegraded":"2024-09-13T17:24:55.778078+0000","last_fullsized":"2024-09-13T17:24:55.778078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:45.368031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'9","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.765693+0000","last_change":"2024-09-13T17:20:50.974897+0000","last_active":"2024-09-13T17:24:55.765693+0000","last_peered":"2024-09-13T17:24:55.765693+0000","last_clean":"2024-09-13T17:24:55.765693+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:24:55.765693+0000","last_undegraded":"2024-09-13T17:24:55.765693+0000","last_fullsized":"2024-09-13T17:24:55.765693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'13","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.781045+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:24:55.781045+0000","last_peered":"2024-09-13T17:24:55.781045+0000","last_clean":"2024-09-13T17:24:55.781045+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:24:55.781045+0000","last_undegraded":"2024-09-13T17:24:55.781045+0000","last_fullsized":"2024-09-13T17:24:55.781045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780671+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:24:55.780671+0000","last_peered":"2024-09-13T17:24:55.780671+0000","last_clean":"2024-09-13T17:24:55.780671+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:24:55.780671+0000","last_undegraded":"2024-09-13T17:24:55.780671+0000","last_fullsized":"2024-09-13T17:24:55.780671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.774800+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:24:55.774800+0000","last_peered":"2024-09-13T17:24:55.774800+0000","last_clean":"2024-09-13T17:24:55.774800+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:24:55.774800+0000","last_undegraded":"2024-09-13T17:24:55.774800+0000","last_fullsized":"2024-09-13T17:24:55.774800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.769233+0000","last_change":"2024-09-13T17:20:50.994986+0000","last_active":"2024-09-13T17:24:55.769233+0000","last_peered":"2024-09-13T17:24:55.769233+0000","last_clean":"2024-09-13T17:24:55.769233+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:24:55.769233+0000","last_undegraded":"2024-09-13T17:24:55.769233+0000","last_fullsized":"2024-09-13T17:24:55.769233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'12","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.761076+0000","last_change":"2024-09-13T17:20:50.977884+0000","last_active":"2024-09-13T17:24:55.761076+0000","last_peered":"2024-09-13T17:24:55.761076+0000","last_clean":"2024-09-13T17:24:55.761076+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:24:55.761076+0000","last_undegraded":"2024-09-13T17:24:55.761076+0000","last_fullsized":"2024-09-13T17:24:55.761076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778742+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:24:55.778742+0000","last_peered":"2024-09-13T17:24:55.778742+0000","last_clean":"2024-09-13T17:24:55.778742+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:24:55.778742+0000","last_undegraded":"2024-09-13T17:24:55.778742+0000","last_fullsized":"2024-09-13T17:24:55.778742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:35.290148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780035+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:24:55.780035+0000","last_peered":"2024-09-13T17:24:55.780035+0000","last_clean":"2024-09-13T17:24:55.780035+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:24:55.780035+0000","last_undegraded":"2024-09-13T17:24:55.780035+0000","last_fullsized":"2024-09-13T17:24:55.780035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:27.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.761138+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:24:55.761138+0000","last_peered":"2024-09-13T17:24:55.761138+0000","last_clean":"2024-09-13T17:24:55.761138+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:24:55.761138+0000","last_undegraded":"2024-09-13T17:24:55.761138+0000","last_fullsized":"2024-09-13T17:24:55.761138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.745762+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:24:55.745762+0000","last_peered":"2024-09-13T17:24:55.745762+0000","last_clean":"2024-09-13T17:24:55.745762+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:24:55.745762+0000","last_undegraded":"2024-09-13T17:24:55.745762+0000","last_fullsized":"2024-09-13T17:24:55.745762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:45.830876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.759762+0000","last_change":"2024-09-13T17:20:50.963432+0000","last_active":"2024-09-13T17:24:55.759762+0000","last_peered":"2024-09-13T17:24:55.759762+0000","last_clean":"2024-09-13T17:24:55.759762+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:24:55.759762+0000","last_undegraded":"2024-09-13T17:24:55.759762+0000","last_fullsized":"2024-09-13T17:24:55.759762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.763076+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:24:55.763076+0000","last_peered":"2024-09-13T17:24:55.763076+0000","last_clean":"2024-09-13T17:24:55.763076+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:24:55.763076+0000","last_undegraded":"2024-09-13T17:24:55.763076+0000","last_fullsized":"2024-09-13T17:24:55.763076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:25.795726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.771961+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:24:55.771961+0000","last_peered":"2024-09-13T17:24:55.771961+0000","last_clean":"2024-09-13T17:24:55.771961+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:24:55.771961+0000","last_undegraded":"2024-09-13T17:24:55.771961+0000","last_fullsized":"2024-09-13T17:24:55.771961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:00.214039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.782623+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:24:55.782623+0000","last_peered":"2024-09-13T17:24:55.782623+0000","last_clean":"2024-09-13T17:24:55.782623+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:24:55.782623+0000","last_undegraded":"2024-09-13T17:24:55.782623+0000","last_fullsized":"2024-09-13T17:24:55.782623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:32.347500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'9","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780232+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:24:55.780232+0000","last_peered":"2024-09-13T17:24:55.780232+0000","last_clean":"2024-09-13T17:24:55.780232+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:24:55.780232+0000","last_undegraded":"2024-09-13T17:24:55.780232+0000","last_fullsized":"2024-09-13T17:24:55.780232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.558630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.746717+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:24:55.746717+0000","last_peered":"2024-09-13T17:24:55.746717+0000","last_clean":"2024-09-13T17:24:55.746717+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:24:55.746717+0000","last_undegraded":"2024-09-13T17:24:55.746717+0000","last_fullsized":"2024-09-13T17:24:55.746717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.777446+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:24:55.777446+0000","last_peered":"2024-09-13T17:24:55.777446+0000","last_clean":"2024-09-13T17:24:55.777446+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:24:55.777446+0000","last_undegraded":"2024-09-13T17:24:55.777446+0000","last_fullsized":"2024-09-13T17:24:55.777446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:21.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'5","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.743981+0000","last_change":"2024-09-13T17:21:32.721986+0000","last_active":"2024-09-13T17:24:55.743981+0000","last_peered":"2024-09-13T17:24:55.743981+0000","last_clean":"2024-09-13T17:24:55.743981+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:24:55.743981+0000","last_undegraded":"2024-09-13T17:24:55.743981+0000","last_fullsized":"2024-09-13T17:24:55.743981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778310+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:24:55.778310+0000","last_peered":"2024-09-13T17:24:55.778310+0000","last_clean":"2024-09-13T17:24:55.778310+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:24:55.778310+0000","last_undegraded":"2024-09-13T17:24:55.778310+0000","last_fullsized":"2024-09-13T17:24:55.778310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:54.199511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.774556+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:24:55.774556+0000","last_peered":"2024-09-13T17:24:55.774556+0000","last_clean":"2024-09-13T17:24:55.774556+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:24:55.774556+0000","last_undegraded":"2024-09-13T17:24:55.774556+0000","last_fullsized":"2024-09-13T17:24:55.774556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:15.031796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'8","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.741447+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:24:55.741447+0000","last_peered":"2024-09-13T17:24:55.741447+0000","last_clean":"2024-09-13T17:24:55.741447+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:24:55.741447+0000","last_undegraded":"2024-09-13T17:24:55.741447+0000","last_fullsized":"2024-09-13T17:24:55.741447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:35.953679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.745054+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:24:55.745054+0000","last_peered":"2024-09-13T17:24:55.745054+0000","last_clean":"2024-09-13T17:24:55.745054+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:24:55.745054+0000","last_undegraded":"2024-09-13T17:24:55.745054+0000","last_fullsized":"2024-09-13T17:24:55.745054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:10.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780403+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:24:55.780403+0000","last_peered":"2024-09-13T17:24:55.780403+0000","last_clean":"2024-09-13T17:24:55.780403+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:24:55.780403+0000","last_undegraded":"2024-09-13T17:24:55.780403+0000","last_fullsized":"2024-09-13T17:24:55.780403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:36.096708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":824896,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":149,"num_write_kb":884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":1649792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.86799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.081,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2150000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.88700000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.92800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0660000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1379999999999999,"5min":1.216,"15min":1.216},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.84099999999999997},"min":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.526,"15min":1.526},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.91000000000000003,"15min":0.93799999999999994},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.165,"5min":1.23,"15min":1.23},"last":0.871}]},{"osd":4,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96699999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.109,"5min":1.365,"15min":1.365},"last":1.0640000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.167,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0720000000000001,"15min":1.1200000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.218,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.88900000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2549999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.90600000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1130496,"data_stored":937202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.501,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1140000000000001,"5min":1.167,"15min":1.167},"last":0.627}]},{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.84199999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1379999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0880000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.875,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.181,"5min":1.615,"15min":1.615},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.268,"15min":1.268},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":2.149,"15min":2.149},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98999999999999999,"15min":1.018},"min":{"1min":0.70099999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1200000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.218,"5min":1.367,"15min":1.367},"last":1.002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0429999999999999,"15min":1.0669999999999999},"min":{"1min":0.68500000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.21,"5min":2.069,"15min":2.069},"last":1.0409999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.077},"min":{"1min":0.76300000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2150000000000001,"5min":1.964,"15min":1.964},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.73299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.619,"15min":1.619},"last":1.103}]}]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.232,"15min":1.232},"last":0.501},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.84999999999999998},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.84599999999999997,"15min":0.86399999999999999},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.89200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.71999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.466,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97299999999999998,"15min":0.997},"min":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.276,"5min":1.339,"15min":1.339},"last":0.97499999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.97399999999999998,"15min":0.94999999999999996},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.075,"15min":1.1040000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":1.339,"15min":1.339},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.84299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.012}]},{"osd":7,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.129,"15min":1.159},"min":{"1min":0.872,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.21},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0640000000000001,"15min":1.0940000000000001},"min":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1759999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.111,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.873,"15min":0.92700000000000005},"min":{"1min":0.505,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0049999999999999,"5min":1.611,"15min":1.611},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78800000000000003,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79700000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.879},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.1120000000000001,"5min":1.23,"15min":1.23},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90200000000000002,"15min":0.96899999999999997},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1020000000000001,"5min":1.754,"15min":1.754},"last":1.0169999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1990000000000001,"5min":1.268,"15min":1.268},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.92300000000000004,"15min":0.98299999999999998},"min":{"1min":0.68000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.78,"15min":1.78},"last":0.93400000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0960000000000001,"5min":1.694,"15min":1.694},"last":1.212},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.032,"15min":1.0840000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1399999999999999,"5min":1.907,"15min":1.907},"last":1.097}]},{"osd":6,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.97899999999999998,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1299999999999999,"5min":1.53,"15min":1.53},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0509999999999999,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1539999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.262}]},{"osd":7,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.1220000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.137,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.089,"15min":1.147},"min":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1970000000000001,"5min":1.863,"15min":1.863},"last":1.125}]}]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1142784,"data_stored":948227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.78000000000000003,"5min":1.014,"15min":1.014},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.054,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.66200000000000003},"min":{"1min":0.32000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.34599999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.93999999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.70499999999999996},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1060000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.71499999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.022,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.02,"5min":1.51,"15min":1.51},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3300000000000001,"5min":1.421,"15min":1.421},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.61499999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1020000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96799999999999997,"15min":1.01},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.397,"5min":1.712,"15min":1.712},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3280000000000001,"5min":1.756,"15min":1.756},"last":1.079},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94799999999999995,"15min":1.004},"min":{"1min":0.59499999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.248,"5min":1.946,"15min":1.946},"last":0.999}]}]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.61599999999999999},"min":{"1min":0.26000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.62,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.85199999999999998,"5min":1.466,"15min":1.466},"last":0.30599999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59399999999999997,"15min":0.622},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95199999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.29699999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.94099999999999995,"5min":1.419,"15min":1.419},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.72199999999999998},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91600000000000004,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.625,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.878,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1020000000000001,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91300000000000003,"15min":0.96699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2529999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":0.97999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2669999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3580000000000001,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95299999999999996,"15min":1.026},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3049999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":1.02},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.65000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3400000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.55900000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57599999999999996,"15min":0.626},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.438}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63800000000000001,"15min":0.66700000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.873,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89400000000000002,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.38},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":1.214,"5min":1.401,"15min":1.401},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.877},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.88700000000000001},"min":{"1min":0.57499999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.266,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88800000000000001,"15min":0.93899999999999995},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2709999999999999,"5min":1.365,"15min":1.365},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86499999999999999,"15min":0.91700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1870000000000001,"5min":1.323,"15min":1.323},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.995},"min":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.23,"5min":1.639,"15min":1.639},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92600000000000005,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.528,"15min":1.528},"last":0.98299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":135154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.58899999999999997},"min":{"1min":0.28399999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.60499999999999998},"min":{"1min":0.308,"5min":0.255,"15min":0.255},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83499999999999996,"5min":1.075,"15min":1.075},"last":1.026},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.66200000000000003},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60799999999999998,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.88400000000000001,"5min":1.034,"15min":1.034},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.72999999999999998},"min":{"1min":0.36199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.91300000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.88200000000000001},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.153,"5min":1.351,"15min":1.351},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0109999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.94599999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.878,"15min":0.93799999999999994},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.056,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1799999999999999,"5min":1.21,"15min":1.21},"last":1.2270000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.92200000000000004},"min":{"1min":0.56799999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1359999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.425,"15min":1.425},"last":1.149}]},{"osd":7,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.127,"5min":1.554,"15min":1.554},"last":1.2969999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92100000000000004,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1040000000000001,"5min":1.454,"15min":1.454},"last":1.0549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":824098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":813073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:25:02.528 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.528 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.528 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.529 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.529 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.529 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.529 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.529 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.529 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.529 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.530 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.530 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.530 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.530 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.530 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.530 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.530 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.531 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.531 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.531 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.531 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.531 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.532 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.532 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.532 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.532 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.533 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.533 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.533 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.533 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.533 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.534 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T17:20:40.345043+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.535 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.536 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.537 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.538 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.539 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.540 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.540 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.540 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.540 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.540 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.540 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.541 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.541 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.541 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.541 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.542 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.542 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.542 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.542 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.543 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.543 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.543 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.543 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.543 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.543 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.543 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.544 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.545 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.546 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.546 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.546 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.546 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.546 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.546 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:02.546 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:25:22.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:25:22.466 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:25:22.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:25:22.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 Processor -- start 2024-09-13T17:25:22.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 -- start start 2024-09-13T17:25:22.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2488065ee0 0x7f2488146d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24880b4f40 0x7f2488143930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24880af500 con 0x7f2488065ee0 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24880b53b0 con 0x7f24880b4f40 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248ef8d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24880662c0 con 0x7f24880b45a0 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2488065ee0 0x7f2488146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2488065ee0 0x7f2488146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53908/0 (socket says 172.21.15.167:53908) 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 -- 172.21.15.167:0/3682575506 learned_addr learned my addr 172.21.15.167:0/3682575506 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f2487fff640 1 --2- 172.21.15.167:0/3682575506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 -- 172.21.15.167:0/3682575506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 msgr2=0x7f24880b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248d52a640 1 --2- 172.21.15.167:0/3682575506 >> v2:172.21.15.190:3300/0 conn(0x7f24880b4f40 0x7f2488143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 --2- 172.21.15.167:0/3682575506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 -- 172.21.15.167:0/3682575506 >> v2:172.21.15.190:3300/0 conn(0x7f24880b4f40 msgr2=0x7f2488143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 --2- 172.21.15.167:0/3682575506 >> v2:172.21.15.190:3300/0 conn(0x7f24880b4f40 0x7f2488143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f248cd29640 1 -- 172.21.15.167:0/3682575506 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880afef0 con 0x7f2488065ee0 2024-09-13T17:25:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.677+0000 7f2487fff640 1 --2- 172.21.15.167:0/3682575506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248cd29640 1 --2- 172.21.15.167:0/3682575506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2488065ee0 0x7f2488146d50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2488071560 tx=0x7f247801c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56983b4f6e5c32e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f24877fe640 1 -- 172.21.15.167:0/3682575506 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24780ab600 con 0x7f2488065ee0 2024-09-13T17:25:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f24877fe640 1 -- 172.21.15.167:0/3682575506 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24780a7050 con 0x7f2488065ee0 2024-09-13T17:25:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f24877fe640 1 -- 172.21.15.167:0/3682575506 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24780ab980 con 0x7f2488065ee0 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- 172.21.15.167:0/3682575506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2488065ee0 msgr2=0x7f2488146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3682575506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2488065ee0 0x7f2488146d50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2488071560 tx=0x7f247801c110 comp rx=0 tx=0).stop 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- 172.21.15.167:0/3682575506 shutdown_connections 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3682575506 >> v2:172.21.15.190:3300/0 conn(0x7f24880b4f40 0x7f2488143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3682575506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3682575506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2488065ee0 0x7f2488146d50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- 172.21.15.167:0/3682575506 >> 172.21.15.167:0/3682575506 conn(0x7f248806cc50 msgr2=0x7f248806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- 172.21.15.167:0/3682575506 shutdown_connections 2024-09-13T17:25:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- 172.21.15.167:0/3682575506 wait complete. 2024-09-13T17:25:22.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 Processor -- start 2024-09-13T17:25:22.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- start start 2024-09-13T17:25:22.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2488065ee0 0x7f248814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24880b4f40 0x7f248813c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880b5de0 con 0x7f24880b4f40 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880b6dc0 con 0x7f2488065ee0 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24880b5a40 con 0x7f24880b45a0 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24880b4f40 0x7f248813c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24880b4f40 0x7f248813c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53912/0 (socket says 172.21.15.167:53912) 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 -- 172.21.15.167:0/3021528763 learned_addr learned my addr 172.21.15.167:0/3021528763 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f2487fff640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248cd29640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2488065ee0 0x7f248814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 -- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 msgr2=0x7f24880b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 -- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2488065ee0 msgr2=0x7f248814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2488065ee0 0x7f248814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 -- 172.21.15.167:0/3021528763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780094d0 con 0x7f24880b4f40 2024-09-13T17:25:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f2487fff640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248d52a640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24880b4f40 0x7f248813c100 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f248000ccb0 tx=0x7f248000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f24857fa640 1 -- 172.21.15.167:0/3021528763 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000ce60 con 0x7f24880b4f40 2024-09-13T17:25:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f24857fa640 1 -- 172.21.15.167:0/3021528763 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24800039a0 con 0x7f24880b4f40 2024-09-13T17:25:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248806f8f0 con 0x7f24880b4f40 2024-09-13T17:25:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f24857fa640 1 -- 172.21.15.167:0/3021528763 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2480003d30 con 0x7f24880b4f40 2024-09-13T17:25:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.681+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24880b74b0 con 0x7f24880b4f40 2024-09-13T17:25:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.685+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24880b41a0 con 0x7f24880b4f40 2024-09-13T17:25:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.685+0000 7f24857fa640 1 -- 172.21.15.167:0/3021528763 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2480003e90 con 0x7f24880b4f40 2024-09-13T17:25:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.685+0000 7f24857fa640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2474066690 0x7f2474068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.685+0000 7f24857fa640 1 -- 172.21.15.167:0/3021528763 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2480084780 con 0x7f24880b4f40 2024-09-13T17:25:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.685+0000 7f248cd29640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2474066690 0x7f2474068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.685+0000 7f248cd29640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2474066690 0x7f2474068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f24780ad000 tx=0x7f2478008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.689+0000 7f24857fa640 1 -- 172.21.15.167:0/3021528763 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24800517a0 con 0x7f24880b4f40 2024-09-13T17:25:22.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.845+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24880af810 con 0x7f2474066690 2024-09-13T17:25:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.857+0000 7f24857fa640 1 -- 172.21.15.167:0/3021528763 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+366031 (secure 0 0 0) 0x7f24780ab760 con 0x7f2474066690 2024-09-13T17:25:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:25:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:25:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.861+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2474066690 msgr2=0x7f2474068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.861+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2474066690 0x7f2474068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f24780ad000 tx=0x7f2478008040 comp rx=0 tx=0).stop 2024-09-13T17:25:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.861+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24880b4f40 msgr2=0x7f248813c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.861+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24880b4f40 0x7f248813c100 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f248000ccb0 tx=0x7f248000a5c0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 shutdown_connections 2024-09-13T17:25:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f2474066690 0x7f2474068b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24880b4f40 0x7f248813c100 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24880b45a0 0x7f24880b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 --2- 172.21.15.167:0/3021528763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2488065ee0 0x7f248814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 >> 172.21.15.167:0/3021528763 conn(0x7f248806cc50 msgr2=0x7f2488144d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 shutdown_connections 2024-09-13T17:25:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:22.865+0000 7f248ef8d640 1 -- 172.21.15.167:0/3021528763 wait complete. 2024-09-13T17:25:22.885 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-13T17:25:21.585788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1417001,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":122,"num_write":318,"num_write_kb":3307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":887,"ondisk_log_size":887,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225456,"kb_used_data":5232,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749264,"statfs":{"total":773094113280,"available":772863246336,"internally_reserved":0,"allocated":5357568,"data_stored":3827034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":225431098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005283"},"pg_stats":[{"pgid":"2.1f","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.628537+0000","last_change":"2024-09-13T17:25:02.628537+0000","last_active":"2024-09-13T17:25:02.628537+0000","last_peered":"2024-09-13T17:25:02.628537+0000","last_clean":"2024-09-13T17:25:02.628537+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:25:02.628537+0000","last_undegraded":"2024-09-13T17:25:02.628537+0000","last_fullsized":"2024-09-13T17:25:02.628537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.628245+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:24.649049+0000","scrub_duration":0.0070116220000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.704444+0000","last_change":"2024-09-13T17:25:06.704636+0000","last_active":"2024-09-13T17:25:06.704444+0000","last_peered":"2024-09-13T17:25:06.704444+0000","last_clean":"2024-09-13T17:25:06.704444+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:25:06.704444+0000","last_undegraded":"2024-09-13T17:25:06.704444+0000","last_fullsized":"2024-09-13T17:25:06.704444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.704389+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:51.558080+0000","scrub_duration":0.003418436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.555827+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:23:23.555827+0000","last_peered":"2024-09-13T17:23:23.555827+0000","last_clean":"2024-09-13T17:23:23.555827+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:23:23.555827+0000","last_undegraded":"2024-09-13T17:23:23.555827+0000","last_fullsized":"2024-09-13T17:23:23.555827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:53.569634+0000","last_change":"2024-09-13T17:20:50.585802+0000","last_active":"2024-09-13T17:24:53.569634+0000","last_peered":"2024-09-13T17:24:53.569634+0000","last_clean":"2024-09-13T17:24:53.569634+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:24:53.569634+0000","last_undegraded":"2024-09-13T17:24:53.569634+0000","last_fullsized":"2024-09-13T17:24:53.569634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.000415+0000","last_change":"2024-09-13T17:20:50.970734+0000","last_active":"2024-09-13T17:24:59.000415+0000","last_peered":"2024-09-13T17:24:59.000415+0000","last_clean":"2024-09-13T17:24:59.000415+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:24:59.000415+0000","last_undegraded":"2024-09-13T17:24:59.000415+0000","last_fullsized":"2024-09-13T17:24:59.000415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.555632+0000","last_change":"2024-09-13T17:20:55.001912+0000","last_active":"2024-09-13T17:23:23.555632+0000","last_peered":"2024-09-13T17:23:23.555632+0000","last_clean":"2024-09-13T17:23:23.555632+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:23:23.555632+0000","last_undegraded":"2024-09-13T17:23:23.555632+0000","last_fullsized":"2024-09-13T17:23:23.555632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.557267+0000","last_change":"2024-09-13T17:20:50.618281+0000","last_active":"2024-09-13T17:23:23.557267+0000","last_peered":"2024-09-13T17:23:23.557267+0000","last_clean":"2024-09-13T17:23:23.557267+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:23:23.557267+0000","last_undegraded":"2024-09-13T17:23:23.557267+0000","last_fullsized":"2024-09-13T17:23:23.557267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780448+0000","last_change":"2024-09-13T17:20:50.989077+0000","last_active":"2024-09-13T17:24:55.780448+0000","last_peered":"2024-09-13T17:24:55.780448+0000","last_clean":"2024-09-13T17:24:55.780448+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:24:55.780448+0000","last_undegraded":"2024-09-13T17:24:55.780448+0000","last_fullsized":"2024-09-13T17:24:55.780448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:28.556722+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:23:28.556722+0000","last_peered":"2024-09-13T17:23:28.556722+0000","last_clean":"2024-09-13T17:23:28.556722+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:23:28.556722+0000","last_undegraded":"2024-09-13T17:23:28.556722+0000","last_fullsized":"2024-09-13T17:23:28.556722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:08.412481+0000","last_change":"2024-09-13T17:25:08.412674+0000","last_active":"2024-09-13T17:25:08.412481+0000","last_peered":"2024-09-13T17:25:08.412481+0000","last_clean":"2024-09-13T17:25:08.412481+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:25:08.412481+0000","last_undegraded":"2024-09-13T17:25:08.412481+0000","last_fullsized":"2024-09-13T17:25:08.412481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_clean_scrub_stamp":"2024-09-13T17:25:08.412427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:29.772409+0000","scrub_duration":0.0057650419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'14","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.777127+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:24:55.777127+0000","last_peered":"2024-09-13T17:24:55.777127+0000","last_clean":"2024-09-13T17:24:55.777127+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:24:55.777127+0000","last_undegraded":"2024-09-13T17:24:55.777127+0000","last_fullsized":"2024-09-13T17:24:55.777127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:28.556673+0000","last_change":"2024-09-13T17:20:54.994749+0000","last_active":"2024-09-13T17:23:28.556673+0000","last_peered":"2024-09-13T17:23:28.556673+0000","last_clean":"2024-09-13T17:23:28.556673+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:23:28.556673+0000","last_undegraded":"2024-09-13T17:23:28.556673+0000","last_fullsized":"2024-09-13T17:23:28.556673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714518+0000","last_change":"2024-09-13T17:20:50.979614+0000","last_active":"2024-09-13T17:25:01.714518+0000","last_peered":"2024-09-13T17:25:01.714518+0000","last_clean":"2024-09-13T17:25:01.714518+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:25:01.714518+0000","last_undegraded":"2024-09-13T17:25:01.714518+0000","last_fullsized":"2024-09-13T17:25:01.714518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.413651+0000","last_change":"2024-09-13T17:25:17.413865+0000","last_active":"2024-09-13T17:25:17.413651+0000","last_peered":"2024-09-13T17:25:17.413651+0000","last_clean":"2024-09-13T17:25:17.413651+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:25:17.413651+0000","last_undegraded":"2024-09-13T17:25:17.413651+0000","last_fullsized":"2024-09-13T17:25:17.413651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.413598+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:25.054898+0000","scrub_duration":0.0059348559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:13.553972+0000","last_change":"2024-09-13T17:20:55.002034+0000","last_active":"2024-09-13T17:23:13.553972+0000","last_peered":"2024-09-13T17:23:13.553972+0000","last_clean":"2024-09-13T17:23:13.553972+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:23:13.553972+0000","last_undegraded":"2024-09-13T17:23:13.553972+0000","last_fullsized":"2024-09-13T17:23:13.553972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.698637+0000","last_change":"2024-09-13T17:25:04.698823+0000","last_active":"2024-09-13T17:25:04.698637+0000","last_peered":"2024-09-13T17:25:04.698637+0000","last_clean":"2024-09-13T17:25:04.698637+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:25:04.698637+0000","last_undegraded":"2024-09-13T17:25:04.698637+0000","last_fullsized":"2024-09-13T17:25:04.698637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.698582+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:43.902693+0000","scrub_duration":0.0032068940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.218192+0000","last_change":"2024-09-13T17:25:14.218382+0000","last_active":"2024-09-13T17:25:14.218192+0000","last_peered":"2024-09-13T17:25:14.218192+0000","last_clean":"2024-09-13T17:25:14.218192+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:25:14.218192+0000","last_undegraded":"2024-09-13T17:25:14.218192+0000","last_fullsized":"2024-09-13T17:25:14.218192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.218137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:53.422249+0000","scrub_duration":0.002748159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:13.553902+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:23:13.553902+0000","last_peered":"2024-09-13T17:23:13.553902+0000","last_clean":"2024-09-13T17:23:13.553902+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:23:13.553902+0000","last_undegraded":"2024-09-13T17:23:13.553902+0000","last_fullsized":"2024-09-13T17:23:13.553902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357697+0000","last_change":"2024-09-13T17:20:50.945905+0000","last_active":"2024-09-13T17:25:00.357697+0000","last_peered":"2024-09-13T17:25:00.357697+0000","last_clean":"2024-09-13T17:25:00.357697+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:25:00.357697+0000","last_undegraded":"2024-09-13T17:25:00.357697+0000","last_fullsized":"2024-09-13T17:25:00.357697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.208492+0000","last_change":"2024-09-13T17:25:02.208492+0000","last_active":"2024-09-13T17:25:02.208492+0000","last_peered":"2024-09-13T17:25:02.208492+0000","last_clean":"2024-09-13T17:25:02.208492+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:25:02.208492+0000","last_undegraded":"2024-09-13T17:25:02.208492+0000","last_fullsized":"2024-09-13T17:25:02.208492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.208341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:23.568323+0000","scrub_duration":0.0022388500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:13.546499+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:23:13.546499+0000","last_peered":"2024-09-13T17:23:13.546499+0000","last_clean":"2024-09-13T17:23:13.546499+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:23:13.546499+0000","last_undegraded":"2024-09-13T17:23:13.546499+0000","last_fullsized":"2024-09-13T17:23:13.546499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.203514+0000","last_change":"2024-09-13T17:25:07.203514+0000","last_active":"2024-09-13T17:25:07.203514+0000","last_peered":"2024-09-13T17:25:07.203514+0000","last_clean":"2024-09-13T17:25:07.203514+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:25:07.203514+0000","last_undegraded":"2024-09-13T17:25:07.203514+0000","last_fullsized":"2024-09-13T17:25:07.203514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.203223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:55.648120+0000","scrub_duration":0.0035296839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.160208+0000","last_change":"2024-09-13T17:20:50.609616+0000","last_active":"2024-09-13T17:25:02.160208+0000","last_peered":"2024-09-13T17:25:02.160208+0000","last_clean":"2024-09-13T17:25:02.160208+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:25:02.160208+0000","last_undegraded":"2024-09-13T17:25:02.160208+0000","last_fullsized":"2024-09-13T17:25:02.160208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:13.553999+0000","last_change":"2024-09-13T17:21:33.376826+0000","last_active":"2024-09-13T17:23:13.553999+0000","last_peered":"2024-09-13T17:23:13.553999+0000","last_clean":"2024-09-13T17:23:13.553999+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:23:13.553999+0000","last_undegraded":"2024-09-13T17:23:13.553999+0000","last_fullsized":"2024-09-13T17:23:13.553999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.671539+0000","last_change":"2024-09-13T17:25:15.671748+0000","last_active":"2024-09-13T17:25:15.671539+0000","last_peered":"2024-09-13T17:25:15.671539+0000","last_clean":"2024-09-13T17:25:15.671539+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:25:15.671539+0000","last_undegraded":"2024-09-13T17:25:15.671539+0000","last_fullsized":"2024-09-13T17:25:15.671539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.671487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.525179+0000","scrub_duration":0.0032178739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.817097+0000","last_change":"2024-09-13T17:25:07.817097+0000","last_active":"2024-09-13T17:25:07.817097+0000","last_peered":"2024-09-13T17:25:07.817097+0000","last_clean":"2024-09-13T17:25:07.817097+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:25:07.817097+0000","last_undegraded":"2024-09-13T17:25:07.817097+0000","last_fullsized":"2024-09-13T17:25:07.817097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.816834+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:51.570981+0000","scrub_duration":0.005827853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.806803+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:25:00.806803+0000","last_peered":"2024-09-13T17:25:00.806803+0000","last_clean":"2024-09-13T17:25:00.806803+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:25:00.806803+0000","last_undegraded":"2024-09-13T17:25:00.806803+0000","last_fullsized":"2024-09-13T17:25:00.806803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357633+0000","last_change":"2024-09-13T17:20:50.991414+0000","last_active":"2024-09-13T17:25:00.357633+0000","last_peered":"2024-09-13T17:25:00.357633+0000","last_clean":"2024-09-13T17:25:00.357633+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:25:00.357633+0000","last_undegraded":"2024-09-13T17:25:00.357633+0000","last_fullsized":"2024-09-13T17:25:00.357633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'23","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.112478+0000","last_change":"2024-09-13T17:25:18.112726+0000","last_active":"2024-09-13T17:25:18.112478+0000","last_peered":"2024-09-13T17:25:18.112478+0000","last_clean":"2024-09-13T17:25:18.112478+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:25:18.112478+0000","last_undegraded":"2024-09-13T17:25:18.112478+0000","last_fullsized":"2024-09-13T17:25:18.112478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.112416+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:20.248318+0000","scrub_duration":0.0039924269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:58.570143+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:24:58.570143+0000","last_peered":"2024-09-13T17:24:58.570143+0000","last_clean":"2024-09-13T17:24:58.570143+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:24:58.570143+0000","last_undegraded":"2024-09-13T17:24:58.570143+0000","last_fullsized":"2024-09-13T17:24:58.570143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'11","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.451016+0000","last_change":"2024-09-13T17:20:50.949838+0000","last_active":"2024-09-13T17:24:59.451016+0000","last_peered":"2024-09-13T17:24:59.451016+0000","last_clean":"2024-09-13T17:24:59.451016+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:24:59.451016+0000","last_undegraded":"2024-09-13T17:24:59.451016+0000","last_fullsized":"2024-09-13T17:24:59.451016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.160025+0000","last_change":"2024-09-13T17:20:50.606519+0000","last_active":"2024-09-13T17:25:02.160025+0000","last_peered":"2024-09-13T17:25:02.160025+0000","last_clean":"2024-09-13T17:25:02.160025+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:25:02.160025+0000","last_undegraded":"2024-09-13T17:25:02.160025+0000","last_fullsized":"2024-09-13T17:25:02.160025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.000513+0000","last_change":"2024-09-13T17:20:55.186638+0000","last_active":"2024-09-13T17:24:59.000513+0000","last_peered":"2024-09-13T17:24:59.000513+0000","last_clean":"2024-09-13T17:24:59.000513+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:24:59.000513+0000","last_undegraded":"2024-09-13T17:24:59.000513+0000","last_fullsized":"2024-09-13T17:24:59.000513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'6","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.242308+0000","last_change":"2024-09-13T17:21:32.783988+0000","last_active":"2024-09-13T17:25:01.242308+0000","last_peered":"2024-09-13T17:25:01.242308+0000","last_clean":"2024-09-13T17:25:01.242308+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:25:01.242308+0000","last_undegraded":"2024-09-13T17:25:01.242308+0000","last_fullsized":"2024-09-13T17:25:01.242308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:16.154785+0000","last_change":"2024-09-13T17:25:16.154988+0000","last_active":"2024-09-13T17:25:16.154785+0000","last_peered":"2024-09-13T17:25:16.154785+0000","last_clean":"2024-09-13T17:25:16.154785+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:25:16.154785+0000","last_undegraded":"2024-09-13T17:25:16.154785+0000","last_fullsized":"2024-09-13T17:25:16.154785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_clean_scrub_stamp":"2024-09-13T17:25:16.154736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:01.008428+0000","scrub_duration":0.0028624710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.451038+0000","last_change":"2024-09-13T17:20:54.994276+0000","last_active":"2024-09-13T17:24:59.451038+0000","last_peered":"2024-09-13T17:24:59.451038+0000","last_clean":"2024-09-13T17:24:59.451038+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:24:59.451038+0000","last_undegraded":"2024-09-13T17:24:59.451038+0000","last_fullsized":"2024-09-13T17:24:59.451038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.168785+0000","last_change":"2024-09-13T17:25:10.169043+0000","last_active":"2024-09-13T17:25:10.168785+0000","last_peered":"2024-09-13T17:25:10.168785+0000","last_clean":"2024-09-13T17:25:10.168785+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:25:10.168785+0000","last_undegraded":"2024-09-13T17:25:10.168785+0000","last_fullsized":"2024-09-13T17:25:10.168785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.168724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:49.372835+0000","scrub_duration":0.003603452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.184229+0000","last_change":"2024-09-13T17:25:18.184475+0000","last_active":"2024-09-13T17:25:18.184229+0000","last_peered":"2024-09-13T17:25:18.184229+0000","last_clean":"2024-09-13T17:25:18.184229+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:25:18.184229+0000","last_undegraded":"2024-09-13T17:25:18.184229+0000","last_fullsized":"2024-09-13T17:25:18.184229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.184172+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:57.388284+0000","scrub_duration":0.0032424060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.451055+0000","last_change":"2024-09-13T17:20:54.992419+0000","last_active":"2024-09-13T17:24:59.451055+0000","last_peered":"2024-09-13T17:24:59.451055+0000","last_clean":"2024-09-13T17:24:59.451055+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:24:59.451055+0000","last_undegraded":"2024-09-13T17:24:59.451055+0000","last_fullsized":"2024-09-13T17:24:59.451055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.747997+0000","last_change":"2024-09-13T17:20:50.949073+0000","last_active":"2024-09-13T17:24:55.747997+0000","last_peered":"2024-09-13T17:24:55.747997+0000","last_clean":"2024-09-13T17:24:55.747997+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:24:55.747997+0000","last_undegraded":"2024-09-13T17:24:55.747997+0000","last_fullsized":"2024-09-13T17:24:55.747997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'21","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.476799+0000","last_change":"2024-09-13T17:25:07.476991+0000","last_active":"2024-09-13T17:25:07.476799+0000","last_peered":"2024-09-13T17:25:07.476799+0000","last_clean":"2024-09-13T17:25:07.476799+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:25:07.476799+0000","last_undegraded":"2024-09-13T17:25:07.476799+0000","last_fullsized":"2024-09-13T17:25:07.476799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.476745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.046686+0000","scrub_duration":0.0038459200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":15,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.451003+0000","last_change":"2024-09-13T17:20:54.986853+0000","last_active":"2024-09-13T17:24:59.451003+0000","last_peered":"2024-09-13T17:24:59.451003+0000","last_clean":"2024-09-13T17:24:59.451003+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:24:59.451003+0000","last_undegraded":"2024-09-13T17:24:59.451003+0000","last_fullsized":"2024-09-13T17:24:59.451003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.646784+0000","last_change":"2024-09-13T17:25:10.647013+0000","last_active":"2024-09-13T17:25:10.646784+0000","last_peered":"2024-09-13T17:25:10.646784+0000","last_clean":"2024-09-13T17:25:10.646784+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:25:10.646784+0000","last_undegraded":"2024-09-13T17:25:10.646784+0000","last_fullsized":"2024-09-13T17:25:10.646784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.646729+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.288029+0000","scrub_duration":0.0033289930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:53.572965+0000","last_change":"2024-09-13T17:20:50.611097+0000","last_active":"2024-09-13T17:24:53.572965+0000","last_peered":"2024-09-13T17:24:53.572965+0000","last_clean":"2024-09-13T17:24:53.572965+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:24:53.572965+0000","last_undegraded":"2024-09-13T17:24:53.572965+0000","last_fullsized":"2024-09-13T17:24:53.572965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.000496+0000","last_change":"2024-09-13T17:21:33.205535+0000","last_active":"2024-09-13T17:24:59.000496+0000","last_peered":"2024-09-13T17:24:59.000496+0000","last_clean":"2024-09-13T17:24:59.000496+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:24:59.000496+0000","last_undegraded":"2024-09-13T17:24:59.000496+0000","last_fullsized":"2024-09-13T17:24:59.000496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357680+0000","last_change":"2024-09-13T17:21:32.786124+0000","last_active":"2024-09-13T17:25:00.357680+0000","last_peered":"2024-09-13T17:25:00.357680+0000","last_clean":"2024-09-13T17:25:00.357680+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:25:00.357680+0000","last_undegraded":"2024-09-13T17:25:00.357680+0000","last_fullsized":"2024-09-13T17:25:00.357680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.242185+0000","last_change":"2024-09-13T17:20:50.581165+0000","last_active":"2024-09-13T17:25:01.242185+0000","last_peered":"2024-09-13T17:25:01.242185+0000","last_clean":"2024-09-13T17:25:01.242185+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:25:01.242185+0000","last_undegraded":"2024-09-13T17:25:01.242185+0000","last_fullsized":"2024-09-13T17:25:01.242185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.464996+0000","last_change":"2024-09-13T17:25:06.465209+0000","last_active":"2024-09-13T17:25:06.464996+0000","last_peered":"2024-09-13T17:25:06.464996+0000","last_clean":"2024-09-13T17:25:06.464996+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:25:06.464996+0000","last_undegraded":"2024-09-13T17:25:06.464996+0000","last_fullsized":"2024-09-13T17:25:06.464996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.464943+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:50.219090+0000","scrub_duration":0.0095512329999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714768+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:25:01.714768+0000","last_peered":"2024-09-13T17:25:01.714768+0000","last_clean":"2024-09-13T17:25:01.714768+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:25:01.714768+0000","last_undegraded":"2024-09-13T17:25:01.714768+0000","last_fullsized":"2024-09-13T17:25:01.714768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.777557+0000","last_change":"2024-09-13T17:20:50.992697+0000","last_active":"2024-09-13T17:24:55.777557+0000","last_peered":"2024-09-13T17:24:55.777557+0000","last_clean":"2024-09-13T17:24:55.777557+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:24:55.777557+0000","last_undegraded":"2024-09-13T17:24:55.777557+0000","last_fullsized":"2024-09-13T17:24:55.777557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:05.439515+0000","last_change":"2024-09-13T17:25:05.439515+0000","last_active":"2024-09-13T17:25:05.439515+0000","last_peered":"2024-09-13T17:25:05.439515+0000","last_clean":"2024-09-13T17:25:05.439515+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:25:05.439515+0000","last_undegraded":"2024-09-13T17:25:05.439515+0000","last_fullsized":"2024-09-13T17:25:05.439515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_clean_scrub_stamp":"2024-09-13T17:25:05.439251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:16.510107+0000","scrub_duration":0.003462868,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714808+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:25:01.714808+0000","last_peered":"2024-09-13T17:25:01.714808+0000","last_clean":"2024-09-13T17:25:01.714808+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:25:01.714808+0000","last_undegraded":"2024-09-13T17:25:01.714808+0000","last_fullsized":"2024-09-13T17:25:01.714808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.121810+0000","last_change":"2024-09-13T17:25:04.122007+0000","last_active":"2024-09-13T17:25:04.121810+0000","last_peered":"2024-09-13T17:25:04.121810+0000","last_clean":"2024-09-13T17:25:04.121810+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:25:04.121810+0000","last_undegraded":"2024-09-13T17:25:04.121810+0000","last_fullsized":"2024-09-13T17:25:04.121810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.121755+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:47.875902+0000","scrub_duration":0.003354901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.195415+0000","last_change":"2024-09-13T17:25:11.195677+0000","last_active":"2024-09-13T17:25:11.195415+0000","last_peered":"2024-09-13T17:25:11.195415+0000","last_clean":"2024-09-13T17:25:11.195415+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:25:11.195415+0000","last_undegraded":"2024-09-13T17:25:11.195415+0000","last_fullsized":"2024-09-13T17:25:11.195415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.195358+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.836657+0000","scrub_duration":0.0067781489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:13.546322+0000","last_change":"2024-09-13T17:20:55.006348+0000","last_active":"2024-09-13T17:23:13.546322+0000","last_peered":"2024-09-13T17:23:13.546322+0000","last_clean":"2024-09-13T17:23:13.546322+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:23:13.546322+0000","last_undegraded":"2024-09-13T17:23:13.546322+0000","last_fullsized":"2024-09-13T17:23:13.546322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780688+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:24:55.780688+0000","last_peered":"2024-09-13T17:24:55.780688+0000","last_clean":"2024-09-13T17:24:55.780688+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:24:55.780688+0000","last_undegraded":"2024-09-13T17:24:55.780688+0000","last_fullsized":"2024-09-13T17:24:55.780688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.438201+0000","last_change":"2024-09-13T17:25:02.438201+0000","last_active":"2024-09-13T17:25:02.438201+0000","last_peered":"2024-09-13T17:25:02.438201+0000","last_clean":"2024-09-13T17:25:02.438201+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:25:02.438201+0000","last_undegraded":"2024-09-13T17:25:02.438201+0000","last_fullsized":"2024-09-13T17:25:02.438201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.438040+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:16.318970+0000","scrub_duration":0.004819215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.242837+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:25:01.242837+0000","last_peered":"2024-09-13T17:25:01.242837+0000","last_clean":"2024-09-13T17:25:01.242837+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:25:01.242837+0000","last_undegraded":"2024-09-13T17:25:01.242837+0000","last_fullsized":"2024-09-13T17:25:01.242837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.495954+0000","last_change":"2024-09-13T17:25:20.496156+0000","last_active":"2024-09-13T17:25:20.495954+0000","last_peered":"2024-09-13T17:25:20.495954+0000","last_clean":"2024-09-13T17:25:20.495954+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:25:20.495954+0000","last_undegraded":"2024-09-13T17:25:20.495954+0000","last_fullsized":"2024-09-13T17:25:20.495954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.495897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:03.053370+0000","scrub_duration":0.0035695599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.150526+0000","last_change":"2024-09-13T17:25:03.150804+0000","last_active":"2024-09-13T17:25:03.150526+0000","last_peered":"2024-09-13T17:25:03.150526+0000","last_clean":"2024-09-13T17:25:03.150526+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:25:03.150526+0000","last_undegraded":"2024-09-13T17:25:03.150526+0000","last_fullsized":"2024-09-13T17:25:03.150526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.150471+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:57.941093+0000","scrub_duration":0.0066500159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.806836+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:25:00.806836+0000","last_peered":"2024-09-13T17:25:00.806836+0000","last_clean":"2024-09-13T17:25:00.806836+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:25:00.806836+0000","last_undegraded":"2024-09-13T17:25:00.806836+0000","last_fullsized":"2024-09-13T17:25:00.806836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.777616+0000","last_change":"2024-09-13T17:20:50.991193+0000","last_active":"2024-09-13T17:24:55.777616+0000","last_peered":"2024-09-13T17:24:55.777616+0000","last_clean":"2024-09-13T17:24:55.777616+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:24:55.777616+0000","last_undegraded":"2024-09-13T17:24:55.777616+0000","last_fullsized":"2024-09-13T17:24:55.777616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.415495+0000","last_change":"2024-09-13T17:25:04.415704+0000","last_active":"2024-09-13T17:25:04.415495+0000","last_peered":"2024-09-13T17:25:04.415495+0000","last_clean":"2024-09-13T17:25:04.415495+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:25:04.415495+0000","last_undegraded":"2024-09-13T17:25:04.415495+0000","last_fullsized":"2024-09-13T17:25:04.415495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.415439+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:54.834687+0000","scrub_duration":0.0090550500000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.547712+0000","last_change":"2024-09-13T17:20:54.992986+0000","last_active":"2024-09-13T17:23:23.547712+0000","last_peered":"2024-09-13T17:23:23.547712+0000","last_clean":"2024-09-13T17:23:23.547712+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:23:23.547712+0000","last_undegraded":"2024-09-13T17:23:23.547712+0000","last_fullsized":"2024-09-13T17:23:23.547712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.762615+0000","last_change":"2024-09-13T17:20:50.958419+0000","last_active":"2024-09-13T17:24:55.762615+0000","last_peered":"2024-09-13T17:24:55.762615+0000","last_clean":"2024-09-13T17:24:55.762615+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:24:55.762615+0000","last_undegraded":"2024-09-13T17:24:55.762615+0000","last_fullsized":"2024-09-13T17:24:55.762615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:13.551054+0000","last_change":"2024-09-13T17:20:50.612241+0000","last_active":"2024-09-13T17:23:13.551054+0000","last_peered":"2024-09-13T17:23:13.551054+0000","last_clean":"2024-09-13T17:23:13.551054+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:23:13.551054+0000","last_undegraded":"2024-09-13T17:23:13.551054+0000","last_fullsized":"2024-09-13T17:23:13.551054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.555986+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:23:23.555986+0000","last_peered":"2024-09-13T17:23:23.555986+0000","last_clean":"2024-09-13T17:23:23.555986+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:23:23.555986+0000","last_undegraded":"2024-09-13T17:23:23.555986+0000","last_fullsized":"2024-09-13T17:23:23.555986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'20","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.779970+0000","last_change":"2024-09-13T17:20:51.001355+0000","last_active":"2024-09-13T17:24:55.779970+0000","last_peered":"2024-09-13T17:24:55.779970+0000","last_clean":"2024-09-13T17:24:55.779970+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:24:55.779970+0000","last_undegraded":"2024-09-13T17:24:55.779970+0000","last_fullsized":"2024-09-13T17:24:55.779970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:13.559941+0000","last_change":"2024-09-13T17:20:50.595785+0000","last_active":"2024-09-13T17:23:13.559941+0000","last_peered":"2024-09-13T17:23:13.559941+0000","last_clean":"2024-09-13T17:23:13.559941+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:23:13.559941+0000","last_undegraded":"2024-09-13T17:23:13.559941+0000","last_fullsized":"2024-09-13T17:23:13.559941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.555197+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:23:18.555197+0000","last_peered":"2024-09-13T17:23:18.555197+0000","last_clean":"2024-09-13T17:23:18.555197+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:23:18.555197+0000","last_undegraded":"2024-09-13T17:23:18.555197+0000","last_fullsized":"2024-09-13T17:23:18.555197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.669497+0000","last_change":"2024-09-13T17:25:13.669681+0000","last_active":"2024-09-13T17:25:13.669497+0000","last_peered":"2024-09-13T17:25:13.669497+0000","last_clean":"2024-09-13T17:25:13.669497+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:25:13.669497+0000","last_undegraded":"2024-09-13T17:25:13.669497+0000","last_fullsized":"2024-09-13T17:25:13.669497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.669441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:52.873552+0000","scrub_duration":0.0032794059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.611869+0000","last_change":"2024-09-13T17:24:59.611938+0000","last_active":"2024-09-13T17:24:59.611869+0000","last_peered":"2024-09-13T17:24:59.611869+0000","last_clean":"2024-09-13T17:24:59.611869+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:24:59.611869+0000","last_undegraded":"2024-09-13T17:24:59.611869+0000","last_fullsized":"2024-09-13T17:24:59.611869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_clean_scrub_stamp":"2024-09-13T17:24:59.611848+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:43.365995+0000","scrub_duration":0.0050935939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.561925+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:23:23.561925+0000","last_peered":"2024-09-13T17:23:23.561925+0000","last_clean":"2024-09-13T17:23:23.561925+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:23:23.561925+0000","last_undegraded":"2024-09-13T17:23:23.561925+0000","last_fullsized":"2024-09-13T17:23:23.561925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778261+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:24:55.778261+0000","last_peered":"2024-09-13T17:24:55.778261+0000","last_clean":"2024-09-13T17:24:55.778261+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:24:55.778261+0000","last_undegraded":"2024-09-13T17:24:55.778261+0000","last_fullsized":"2024-09-13T17:24:55.778261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'65","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.813465+0000","last_change":"2024-09-13T17:25:09.813678+0000","last_active":"2024-09-13T17:25:09.813465+0000","last_peered":"2024-09-13T17:25:09.813465+0000","last_clean":"2024-09-13T17:25:09.813465+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:25:09.813465+0000","last_undegraded":"2024-09-13T17:25:09.813465+0000","last_fullsized":"2024-09-13T17:25:09.813465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.813409+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:31.173392+0000","scrub_duration":0.0101034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.547466+0000","last_change":"2024-09-13T17:20:54.991084+0000","last_active":"2024-09-13T17:23:18.547466+0000","last_peered":"2024-09-13T17:23:18.547466+0000","last_clean":"2024-09-13T17:23:18.547466+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:23:18.547466+0000","last_undegraded":"2024-09-13T17:23:18.547466+0000","last_fullsized":"2024-09-13T17:23:18.547466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'12","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.781729+0000","last_change":"2024-09-13T17:20:50.996578+0000","last_active":"2024-09-13T17:24:55.781729+0000","last_peered":"2024-09-13T17:24:55.781729+0000","last_clean":"2024-09-13T17:24:55.781729+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:24:55.781729+0000","last_undegraded":"2024-09-13T17:24:55.781729+0000","last_fullsized":"2024-09-13T17:24:55.781729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'15","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:56.125117+0000","last_change":"2024-09-13T17:20:50.603891+0000","last_active":"2024-09-13T17:24:56.125117+0000","last_peered":"2024-09-13T17:24:56.125117+0000","last_clean":"2024-09-13T17:24:56.125117+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:24:56.125117+0000","last_undegraded":"2024-09-13T17:24:56.125117+0000","last_fullsized":"2024-09-13T17:24:56.125117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.554820+0000","last_change":"2024-09-13T17:20:55.004498+0000","last_active":"2024-09-13T17:23:18.554820+0000","last_peered":"2024-09-13T17:23:18.554820+0000","last_clean":"2024-09-13T17:23:18.554820+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:23:18.554820+0000","last_undegraded":"2024-09-13T17:23:18.554820+0000","last_fullsized":"2024-09-13T17:23:18.554820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.527098+0000","last_change":"2024-09-13T17:25:19.527297+0000","last_active":"2024-09-13T17:25:19.527098+0000","last_peered":"2024-09-13T17:25:19.527098+0000","last_clean":"2024-09-13T17:25:19.527098+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:25:19.527098+0000","last_undegraded":"2024-09-13T17:25:19.527098+0000","last_fullsized":"2024-09-13T17:25:19.527098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.527040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:23.337212+0000","scrub_duration":0.0035432609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.561029+0000","last_change":"2024-09-13T17:20:50.607667+0000","last_active":"2024-09-13T17:23:18.561029+0000","last_peered":"2024-09-13T17:23:18.561029+0000","last_clean":"2024-09-13T17:23:18.561029+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:23:18.561029+0000","last_undegraded":"2024-09-13T17:23:18.561029+0000","last_fullsized":"2024-09-13T17:23:18.561029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.554911+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:23:18.554911+0000","last_peered":"2024-09-13T17:23:18.554911+0000","last_clean":"2024-09-13T17:23:18.554911+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:23:18.554911+0000","last_undegraded":"2024-09-13T17:23:18.554911+0000","last_fullsized":"2024-09-13T17:23:18.554911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.088082+0000","last_change":"2024-09-13T17:25:07.088281+0000","last_active":"2024-09-13T17:25:07.088082+0000","last_peered":"2024-09-13T17:25:07.088082+0000","last_clean":"2024-09-13T17:25:07.088082+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:25:07.088082+0000","last_undegraded":"2024-09-13T17:25:07.088082+0000","last_fullsized":"2024-09-13T17:25:07.088082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.088022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:29.108827+0000","scrub_duration":0.0031517120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.552230+0000","last_change":"2024-09-13T17:20:50.612059+0000","last_active":"2024-09-13T17:23:18.552230+0000","last_peered":"2024-09-13T17:23:18.552230+0000","last_clean":"2024-09-13T17:23:18.552230+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:23:18.552230+0000","last_undegraded":"2024-09-13T17:23:18.552230+0000","last_fullsized":"2024-09-13T17:23:18.552230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.555033+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:23:18.555033+0000","last_peered":"2024-09-13T17:23:18.555033+0000","last_clean":"2024-09-13T17:23:18.555033+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:23:18.555033+0000","last_undegraded":"2024-09-13T17:23:18.555033+0000","last_fullsized":"2024-09-13T17:23:18.555033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:58.561910+0000","last_change":"2024-09-13T17:20:55.194501+0000","last_active":"2024-09-13T17:24:58.561910+0000","last_peered":"2024-09-13T17:24:58.561910+0000","last_clean":"2024-09-13T17:24:58.561910+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:24:58.561910+0000","last_undegraded":"2024-09-13T17:24:58.561910+0000","last_fullsized":"2024-09-13T17:24:58.561910+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.248575+0000","last_change":"2024-09-13T17:25:00.248691+0000","last_active":"2024-09-13T17:25:00.248575+0000","last_peered":"2024-09-13T17:25:00.248575+0000","last_clean":"2024-09-13T17:25:00.248575+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:25:00.248575+0000","last_undegraded":"2024-09-13T17:25:00.248575+0000","last_fullsized":"2024-09-13T17:25:00.248575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_clean_scrub_stamp":"2024-09-13T17:25:00.248535+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:44.002682+0000","scrub_duration":0.001465844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.192990+0000","last_change":"2024-09-13T17:25:15.193190+0000","last_active":"2024-09-13T17:25:15.192990+0000","last_peered":"2024-09-13T17:25:15.192990+0000","last_clean":"2024-09-13T17:25:15.192990+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:25:15.192990+0000","last_undegraded":"2024-09-13T17:25:15.192990+0000","last_fullsized":"2024-09-13T17:25:15.192990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.192937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:03.637834+0000","scrub_duration":0.0029227929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714831+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:25:01.714831+0000","last_peered":"2024-09-13T17:25:01.714831+0000","last_clean":"2024-09-13T17:25:01.714831+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:25:01.714831+0000","last_undegraded":"2024-09-13T17:25:01.714831+0000","last_fullsized":"2024-09-13T17:25:01.714831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.743195+0000","last_change":"2024-09-13T17:20:50.955618+0000","last_active":"2024-09-13T17:24:55.743195+0000","last_peered":"2024-09-13T17:24:55.743195+0000","last_clean":"2024-09-13T17:24:55.743195+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:24:55.743195+0000","last_undegraded":"2024-09-13T17:24:55.743195+0000","last_fullsized":"2024-09-13T17:24:55.743195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:18.555068+0000","last_change":"2024-09-13T17:20:50.589407+0000","last_active":"2024-09-13T17:23:18.555068+0000","last_peered":"2024-09-13T17:23:18.555068+0000","last_clean":"2024-09-13T17:23:18.555068+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:23:18.555068+0000","last_undegraded":"2024-09-13T17:23:18.555068+0000","last_fullsized":"2024-09-13T17:23:18.555068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.808936+0000","last_change":"2024-09-13T17:25:04.809132+0000","last_active":"2024-09-13T17:25:04.808936+0000","last_peered":"2024-09-13T17:25:04.808936+0000","last_clean":"2024-09-13T17:25:04.808936+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:25:04.808936+0000","last_undegraded":"2024-09-13T17:25:04.808936+0000","last_fullsized":"2024-09-13T17:25:04.808936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.808880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:50.181093+0000","scrub_duration":0.0030294929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.724340+0000","last_change":"2024-09-13T17:25:17.724560+0000","last_active":"2024-09-13T17:25:17.724340+0000","last_peered":"2024-09-13T17:25:17.724340+0000","last_clean":"2024-09-13T17:25:17.724340+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:25:17.724340+0000","last_undegraded":"2024-09-13T17:25:17.724340+0000","last_fullsized":"2024-09-13T17:25:17.724340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.724289+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:19.860190+0000","scrub_duration":0.003109784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.442800+0000","last_change":"2024-09-13T17:25:14.443046+0000","last_active":"2024-09-13T17:25:14.442800+0000","last_peered":"2024-09-13T17:25:14.442800+0000","last_clean":"2024-09-13T17:25:14.442800+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:25:14.442800+0000","last_undegraded":"2024-09-13T17:25:14.442800+0000","last_fullsized":"2024-09-13T17:25:14.442800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.442749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:47.260752+0000","scrub_duration":0.003699786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.555912+0000","last_change":"2024-09-13T17:20:50.598052+0000","last_active":"2024-09-13T17:23:23.555912+0000","last_peered":"2024-09-13T17:23:23.555912+0000","last_clean":"2024-09-13T17:23:23.555912+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:23:23.555912+0000","last_undegraded":"2024-09-13T17:23:23.555912+0000","last_fullsized":"2024-09-13T17:23:23.555912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:49.547188+0000","last_clean_scrub_stamp":"2024-09-13T17:20:49.547188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:12.189184+0000","last_change":"2024-09-13T17:25:12.189375+0000","last_active":"2024-09-13T17:25:12.189184+0000","last_peered":"2024-09-13T17:25:12.189184+0000","last_clean":"2024-09-13T17:25:12.189184+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:25:12.189184+0000","last_undegraded":"2024-09-13T17:25:12.189184+0000","last_fullsized":"2024-09-13T17:25:12.189184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_clean_scrub_stamp":"2024-09-13T17:25:12.189124+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:57.042815+0000","scrub_duration":0.003516005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:28.556549+0000","last_change":"2024-09-13T17:21:32.724190+0000","last_active":"2024-09-13T17:23:28.556549+0000","last_peered":"2024-09-13T17:23:28.556549+0000","last_clean":"2024-09-13T17:23:28.556549+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:23:28.556549+0000","last_undegraded":"2024-09-13T17:23:28.556549+0000","last_fullsized":"2024-09-13T17:23:28.556549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714654+0000","last_change":"2024-09-13T17:20:50.970324+0000","last_active":"2024-09-13T17:25:01.714654+0000","last_peered":"2024-09-13T17:25:01.714654+0000","last_clean":"2024-09-13T17:25:01.714654+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:25:01.714654+0000","last_undegraded":"2024-09-13T17:25:01.714654+0000","last_fullsized":"2024-09-13T17:25:01.714654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.524174+0000","last_change":"2024-09-13T17:25:09.524398+0000","last_active":"2024-09-13T17:25:09.524174+0000","last_peered":"2024-09-13T17:25:09.524174+0000","last_clean":"2024-09-13T17:25:09.524174+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:25:09.524174+0000","last_undegraded":"2024-09-13T17:25:09.524174+0000","last_fullsized":"2024-09-13T17:25:09.524174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.524113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:20.787851+0000","scrub_duration":0.0037612919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.242568+0000","last_change":"2024-09-13T17:20:50.952009+0000","last_active":"2024-09-13T17:25:01.242568+0000","last_peered":"2024-09-13T17:25:01.242568+0000","last_clean":"2024-09-13T17:25:01.242568+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:25:01.242568+0000","last_undegraded":"2024-09-13T17:25:01.242568+0000","last_fullsized":"2024-09-13T17:25:01.242568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.000427+0000","last_change":"2024-09-13T17:20:50.951297+0000","last_active":"2024-09-13T17:24:59.000427+0000","last_peered":"2024-09-13T17:24:59.000427+0000","last_clean":"2024-09-13T17:24:59.000427+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:24:59.000427+0000","last_undegraded":"2024-09-13T17:24:59.000427+0000","last_fullsized":"2024-09-13T17:24:59.000427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357759+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:25:00.357759+0000","last_peered":"2024-09-13T17:25:00.357759+0000","last_clean":"2024-09-13T17:25:00.357759+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:25:00.357759+0000","last_undegraded":"2024-09-13T17:25:00.357759+0000","last_fullsized":"2024-09-13T17:25:00.357759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.451021+0000","last_change":"2024-09-13T17:20:50.941954+0000","last_active":"2024-09-13T17:24:59.451021+0000","last_peered":"2024-09-13T17:24:59.451021+0000","last_clean":"2024-09-13T17:24:59.451021+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:24:59.451021+0000","last_undegraded":"2024-09-13T17:24:59.451021+0000","last_fullsized":"2024-09-13T17:24:59.451021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'13","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714644+0000","last_change":"2024-09-13T17:20:50.999533+0000","last_active":"2024-09-13T17:25:01.714644+0000","last_peered":"2024-09-13T17:25:01.714644+0000","last_clean":"2024-09-13T17:25:01.714644+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:25:01.714644+0000","last_undegraded":"2024-09-13T17:25:01.714644+0000","last_fullsized":"2024-09-13T17:25:01.714644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357839+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:25:00.357839+0000","last_peered":"2024-09-13T17:25:00.357839+0000","last_clean":"2024-09-13T17:25:00.357839+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:25:00.357839+0000","last_undegraded":"2024-09-13T17:25:00.357839+0000","last_fullsized":"2024-09-13T17:25:00.357839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'9","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.242618+0000","last_change":"2024-09-13T17:20:50.951845+0000","last_active":"2024-09-13T17:25:01.242618+0000","last_peered":"2024-09-13T17:25:01.242618+0000","last_clean":"2024-09-13T17:25:01.242618+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:25:01.242618+0000","last_undegraded":"2024-09-13T17:25:01.242618+0000","last_fullsized":"2024-09-13T17:25:01.242618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.650609+0000","last_change":"2024-09-13T17:25:01.650820+0000","last_active":"2024-09-13T17:25:01.650609+0000","last_peered":"2024-09-13T17:25:01.650609+0000","last_clean":"2024-09-13T17:25:01.650609+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:25:01.650609+0000","last_undegraded":"2024-09-13T17:25:01.650609+0000","last_fullsized":"2024-09-13T17:25:01.650609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_clean_scrub_stamp":"2024-09-13T17:25:01.650556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:50.095453+0000","scrub_duration":0.0034189989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'13","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.781132+0000","last_change":"2024-09-13T17:20:50.993177+0000","last_active":"2024-09-13T17:24:55.781132+0000","last_peered":"2024-09-13T17:24:55.781132+0000","last_clean":"2024-09-13T17:24:55.781132+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:24:55.781132+0000","last_undegraded":"2024-09-13T17:24:55.781132+0000","last_fullsized":"2024-09-13T17:24:55.781132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780766+0000","last_change":"2024-09-13T17:20:50.999206+0000","last_active":"2024-09-13T17:24:55.780766+0000","last_peered":"2024-09-13T17:24:55.780766+0000","last_clean":"2024-09-13T17:24:55.780766+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:24:55.780766+0000","last_undegraded":"2024-09-13T17:24:55.780766+0000","last_fullsized":"2024-09-13T17:24:55.780766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.774950+0000","last_change":"2024-09-13T17:20:50.989234+0000","last_active":"2024-09-13T17:24:55.774950+0000","last_peered":"2024-09-13T17:24:55.774950+0000","last_clean":"2024-09-13T17:24:55.774950+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:24:55.774950+0000","last_undegraded":"2024-09-13T17:24:55.774950+0000","last_fullsized":"2024-09-13T17:24:55.774950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.466987+0000","last_change":"2024-09-13T17:25:03.467180+0000","last_active":"2024-09-13T17:25:03.466987+0000","last_peered":"2024-09-13T17:25:03.466987+0000","last_clean":"2024-09-13T17:25:03.466987+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:25:03.466987+0000","last_undegraded":"2024-09-13T17:25:03.466987+0000","last_fullsized":"2024-09-13T17:25:03.466987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.466932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:48.839144+0000","scrub_duration":0.0033368909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.503101+0000","last_change":"2024-09-13T17:25:11.503305+0000","last_active":"2024-09-13T17:25:11.503101+0000","last_peered":"2024-09-13T17:25:11.503101+0000","last_clean":"2024-09-13T17:25:11.503101+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:25:11.503101+0000","last_undegraded":"2024-09-13T17:25:11.503101+0000","last_fullsized":"2024-09-13T17:25:11.503101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.503041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:37.249276+0000","scrub_duration":0.0030805149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778897+0000","last_change":"2024-09-13T17:20:50.993432+0000","last_active":"2024-09-13T17:24:55.778897+0000","last_peered":"2024-09-13T17:24:55.778897+0000","last_clean":"2024-09-13T17:24:55.778897+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:24:55.778897+0000","last_undegraded":"2024-09-13T17:24:55.778897+0000","last_fullsized":"2024-09-13T17:24:55.778897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.781022+0000","last_change":"2024-09-13T17:20:50.961238+0000","last_active":"2024-09-13T17:24:55.781022+0000","last_peered":"2024-09-13T17:24:55.781022+0000","last_clean":"2024-09-13T17:24:55.781022+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:24:55.781022+0000","last_undegraded":"2024-09-13T17:24:55.781022+0000","last_fullsized":"2024-09-13T17:24:55.781022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.765903+0000","last_change":"2024-09-13T17:20:50.974651+0000","last_active":"2024-09-13T17:24:55.765903+0000","last_peered":"2024-09-13T17:24:55.765903+0000","last_clean":"2024-09-13T17:24:55.765903+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:24:55.765903+0000","last_undegraded":"2024-09-13T17:24:55.765903+0000","last_fullsized":"2024-09-13T17:24:55.765903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.748056+0000","last_change":"2024-09-13T17:20:50.950788+0000","last_active":"2024-09-13T17:24:55.748056+0000","last_peered":"2024-09-13T17:24:55.748056+0000","last_clean":"2024-09-13T17:24:55.748056+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:24:55.748056+0000","last_undegraded":"2024-09-13T17:24:55.748056+0000","last_fullsized":"2024-09-13T17:24:55.748056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.615734+0000","last_change":"2024-09-13T17:25:13.615929+0000","last_active":"2024-09-13T17:25:13.615734+0000","last_peered":"2024-09-13T17:25:13.615734+0000","last_clean":"2024-09-13T17:25:13.615734+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:25:13.615734+0000","last_undegraded":"2024-09-13T17:25:13.615734+0000","last_fullsized":"2024-09-13T17:25:13.615734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.615679+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:35.478210+0000","scrub_duration":0.0034373250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.763267+0000","last_change":"2024-09-13T17:20:50.975816+0000","last_active":"2024-09-13T17:24:55.763267+0000","last_peered":"2024-09-13T17:24:55.763267+0000","last_clean":"2024-09-13T17:24:55.763267+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:24:55.763267+0000","last_undegraded":"2024-09-13T17:24:55.763267+0000","last_fullsized":"2024-09-13T17:24:55.763267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.772108+0000","last_change":"2024-09-13T17:20:50.976040+0000","last_active":"2024-09-13T17:24:55.772108+0000","last_peered":"2024-09-13T17:24:55.772108+0000","last_clean":"2024-09-13T17:24:55.772108+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:24:55.772108+0000","last_undegraded":"2024-09-13T17:24:55.772108+0000","last_fullsized":"2024-09-13T17:24:55.772108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.782720+0000","last_change":"2024-09-13T17:20:50.974419+0000","last_active":"2024-09-13T17:24:55.782720+0000","last_peered":"2024-09-13T17:24:55.782720+0000","last_clean":"2024-09-13T17:24:55.782720+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:24:55.782720+0000","last_undegraded":"2024-09-13T17:24:55.782720+0000","last_fullsized":"2024-09-13T17:24:55.782720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'9","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780544+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:24:55.780544+0000","last_peered":"2024-09-13T17:24:55.780544+0000","last_clean":"2024-09-13T17:24:55.780544+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:24:55.780544+0000","last_undegraded":"2024-09-13T17:24:55.780544+0000","last_fullsized":"2024-09-13T17:24:55.780544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.746815+0000","last_change":"2024-09-13T17:20:50.953065+0000","last_active":"2024-09-13T17:24:55.746815+0000","last_peered":"2024-09-13T17:24:55.746815+0000","last_clean":"2024-09-13T17:24:55.746815+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:24:55.746815+0000","last_undegraded":"2024-09-13T17:24:55.746815+0000","last_fullsized":"2024-09-13T17:24:55.746815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.777546+0000","last_change":"2024-09-13T17:20:50.968256+0000","last_active":"2024-09-13T17:24:55.777546+0000","last_peered":"2024-09-13T17:24:55.777546+0000","last_clean":"2024-09-13T17:24:55.777546+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:24:55.777546+0000","last_undegraded":"2024-09-13T17:24:55.777546+0000","last_fullsized":"2024-09-13T17:24:55.777546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'5","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.500116+0000","last_change":"2024-09-13T17:25:17.500315+0000","last_active":"2024-09-13T17:25:17.500116+0000","last_peered":"2024-09-13T17:25:17.500116+0000","last_clean":"2024-09-13T17:25:17.500116+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:25:17.500116+0000","last_undegraded":"2024-09-13T17:25:17.500116+0000","last_fullsized":"2024-09-13T17:25:17.500116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.500012+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:12.784295+0000","scrub_duration":0.0029179330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780050+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:24:55.780050+0000","last_peered":"2024-09-13T17:24:55.780050+0000","last_clean":"2024-09-13T17:24:55.780050+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:24:55.780050+0000","last_undegraded":"2024-09-13T17:24:55.780050+0000","last_fullsized":"2024-09-13T17:24:55.780050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.775799+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:24:55.775799+0000","last_peered":"2024-09-13T17:24:55.775799+0000","last_clean":"2024-09-13T17:24:55.775799+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:24:55.775799+0000","last_undegraded":"2024-09-13T17:24:55.775799+0000","last_fullsized":"2024-09-13T17:24:55.775799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.000549+0000","last_change":"2024-09-13T17:20:50.950443+0000","last_active":"2024-09-13T17:24:59.000549+0000","last_peered":"2024-09-13T17:24:59.000549+0000","last_clean":"2024-09-13T17:24:59.000549+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:24:59.000549+0000","last_undegraded":"2024-09-13T17:24:59.000549+0000","last_fullsized":"2024-09-13T17:24:59.000549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.450934+0000","last_change":"2024-09-13T17:20:50.952719+0000","last_active":"2024-09-13T17:24:59.450934+0000","last_peered":"2024-09-13T17:24:59.450934+0000","last_clean":"2024-09-13T17:24:59.450934+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:24:59.450934+0000","last_undegraded":"2024-09-13T17:24:59.450934+0000","last_fullsized":"2024-09-13T17:24:59.450934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'10","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.160565+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:25:02.160565+0000","last_peered":"2024-09-13T17:25:02.160565+0000","last_clean":"2024-09-13T17:25:02.160565+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:25:02.160565+0000","last_undegraded":"2024-09-13T17:25:02.160565+0000","last_fullsized":"2024-09-13T17:25:02.160565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":826633,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":153,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":1653266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":259,"ondisk_log_size":259,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.86799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.081,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2150000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.92800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0660000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1379999999999999,"5min":1.216,"15min":1.216},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.84099999999999997},"min":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.526,"15min":1.526},"last":0.91300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.91000000000000003,"15min":0.93799999999999994},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.165,"5min":1.23,"15min":1.23},"last":0.94499999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96699999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.109,"5min":1.365,"15min":1.365},"last":0.79100000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.024},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.167,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.98099999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0720000000000001,"15min":1.1200000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.218,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.88900000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2549999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88400000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1130496,"data_stored":938939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.501,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1140000000000001,"5min":1.167,"15min":1.167},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.84199999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1379999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.022},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0880000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.875,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.181,"5min":1.615,"15min":1.615},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.268,"15min":1.268},"last":1.103}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":2.149,"15min":2.149},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98999999999999999,"15min":1.018},"min":{"1min":0.70099999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1200000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.218,"5min":1.367,"15min":1.367},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0429999999999999,"15min":1.0669999999999999},"min":{"1min":0.68500000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.21,"5min":2.069,"15min":2.069},"last":1.21}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.077},"min":{"1min":0.76300000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2150000000000001,"5min":1.964,"15min":1.964},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.73299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.619,"15min":1.619},"last":1.175}]}]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.232,"15min":1.232},"last":1.179},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0629999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.84999999999999998},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.84599999999999997,"15min":0.86399999999999999},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.226}]},{"osd":2,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.71999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.121}]},{"osd":3,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.466,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97299999999999998,"15min":0.997},"min":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.276,"5min":1.339,"15min":1.339},"last":0.91200000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.97399999999999998,"15min":0.94999999999999996},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.075,"15min":1.1040000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":1.339,"15min":1.339},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.84299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.129,"15min":1.159},"min":{"1min":0.872,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0640000000000001,"15min":1.0940000000000001},"min":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83999999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.111,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.873,"15min":0.92700000000000005},"min":{"1min":0.505,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0049999999999999,"5min":1.611,"15min":1.611},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78800000000000003,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.879},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.1120000000000001,"5min":1.23,"15min":1.23},"last":0.625},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90200000000000002,"15min":0.96899999999999997},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1020000000000001,"5min":1.754,"15min":1.754},"last":0.747}]},{"osd":3,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1990000000000001,"5min":1.268,"15min":1.268},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.92300000000000004,"15min":0.98299999999999998},"min":{"1min":0.68000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.78,"15min":1.78},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0960000000000001,"5min":1.694,"15min":1.694},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.032,"15min":1.0840000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1399999999999999,"5min":1.907,"15min":1.907},"last":0.88600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.97899999999999998,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1299999999999999,"5min":1.53,"15min":1.53},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0509999999999999,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1539999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.0129999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.1220000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.137,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.089,"15min":1.147},"min":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1970000000000001,"5min":1.863,"15min":1.863},"last":0.86299999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1142784,"data_stored":949964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.78000000000000003,"5min":1.014,"15min":1.014},"last":0.504},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.054,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.71199999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.66200000000000003},"min":{"1min":0.32000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.751},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.34599999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.93999999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.70499999999999996},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1060000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.71499999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.022,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.02,"5min":1.51,"15min":1.51},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3300000000000001,"5min":1.421,"15min":1.421},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.0389999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.61499999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1020000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96799999999999997,"15min":1.01},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.397,"5min":1.712,"15min":1.712},"last":0.89200000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3280000000000001,"5min":1.756,"15min":1.756},"last":1.093},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94799999999999995,"15min":1.004},"min":{"1min":0.59499999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.248,"5min":1.946,"15min":1.946},"last":0.86399999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.61599999999999999},"min":{"1min":0.26000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.62,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.85199999999999998,"5min":1.466,"15min":1.466},"last":1.056}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59399999999999997,"15min":0.622},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95199999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.29699999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.94099999999999995,"5min":1.419,"15min":1.419},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.72199999999999998},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91600000000000004,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.625,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.878,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1020000000000001,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91300000000000003,"15min":0.96699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2529999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.214},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":0.97999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2669999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3580000000000001,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95299999999999996,"15min":1.026},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3049999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.99099999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":1.02},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.02},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.65000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3400000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.80100000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57599999999999996,"15min":0.626},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63800000000000001,"15min":0.66700000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.873,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89400000000000002,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":1.214,"5min":1.401,"15min":1.401},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.877},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.88700000000000001},"min":{"1min":0.57499999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.01}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.266,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88800000000000001,"15min":0.93899999999999995},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2709999999999999,"5min":1.365,"15min":1.365},"last":1.034}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86499999999999999,"15min":0.91700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1870000000000001,"5min":1.323,"15min":1.323},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.995},"min":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.23,"5min":1.639,"15min":1.639},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92600000000000005,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.528,"15min":1.528},"last":0.81699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":135154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.58899999999999997},"min":{"1min":0.28399999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.60499999999999998},"min":{"1min":0.308,"5min":0.255,"15min":0.255},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.878}]},{"osd":1,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83499999999999996,"5min":1.075,"15min":1.075},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.66200000000000003},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60799999999999998,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.88400000000000001,"5min":1.034,"15min":1.034},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.72999999999999998},"min":{"1min":0.36199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.91300000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.88200000000000001},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.153,"5min":1.351,"15min":1.351},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0109999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0269999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.878,"15min":0.93799999999999994},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.056,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1799999999999999,"5min":1.21,"15min":1.21},"last":0.94599999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.92200000000000004},"min":{"1min":0.56799999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1359999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.425,"15min":1.425},"last":1.204}]},{"osd":7,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.127,"5min":1.554,"15min":1.554},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92100000000000004,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1040000000000001,"5min":1.454,"15min":1.454},"last":1.5309999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":814810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:25:22.892 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.892 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.892 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.892 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.892 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.892 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.893 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.894 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.895 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.895 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.895 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.895 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.895 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.895 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.896 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.897 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.898 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.898 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.898 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.898 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.898 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.899 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.900 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T17:20:49.547188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.901 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.902 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.903 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.904 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.904 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.904 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.904 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:22.904 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:25:42.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:25:43.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45bc6e640 1 Processor -- start 2024-09-13T17:25:43.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45bc6e640 1 -- start start 2024-09-13T17:25:43.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45bc6e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 0x7fa454145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45bc6e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540b00b0 con 0x7fa4540b1eb0 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45bc6e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540b2290 con 0x7fa45413f9d0 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45bc6e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45406f600 con 0x7fa4540b0540 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459a0a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa4540b1eb0 0x7fa4540b1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39782/0 (socket says 172.21.15.167:39782) 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459a0a640 1 -- 172.21.15.167:0/2194469557 learned_addr learned my addr 172.21.15.167:0/2194469557 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459209640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 0x7fa454145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993237785 0 0) 0x7fa4540b00b0 con 0x7fa4540b1eb0 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa440003530 con 0x7fa4540b1eb0 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1792040940 0 0) 0x7fa440003530 con 0x7fa4540b1eb0 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 msgr2=0x7fa454145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 0x7fa454145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 >> v1:172.21.15.190:6789/0 conn(0x7fa45413f9d0 legacy=0x7fa45414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540afa60 con 0x7fa4540b1eb0 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7fa450001680 con 0x7fa4540b1eb0 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 >> v1:172.21.15.167:6789/0 conn(0x7fa4540b1eb0 legacy=0x7fa4540b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4400039b0 0x7fa440003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4400047d0 0x7fa440004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 0x7fa4400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45406f600 con 0x7fa4400047d0 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44000baf0 con 0x7fa4400039b0 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44000bcb0 con 0x7fa4540b0540 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459209640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4400047d0 0x7fa440004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459a0a640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4400039b0 0x7fa440003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45a20b640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 0x7fa4400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459209640 1 -- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 msgr2=0x7fa4400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459209640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 0x7fa4400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459209640 1 -- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4400039b0 msgr2=0x7fa440003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459209640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4400039b0 0x7fa440003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459209640 1 -- 172.21.15.167:0/2194469557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440003530 con 0x7fa4400047d0 2024-09-13T17:25:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa459a0a640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4400039b0 0x7fa440003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.037+0000 7fa45a20b640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b0540 0x7fa4400051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:43.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa459209640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4400047d0 0x7fa440004c50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa444009670 tx=0x7fa44401ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fab4dcb307bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440a7540 con 0x7fa4400047d0 2024-09-13T17:25:43.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440a76a0 con 0x7fa4400047d0 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa458a08640 1 -- 172.21.15.167:0/2194469557 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440a7a10 con 0x7fa4400047d0 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- 172.21.15.167:0/2194469557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4400047d0 msgr2=0x7fa440004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 --2- 172.21.15.167:0/2194469557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4400047d0 0x7fa440004c50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa444009670 tx=0x7fa44401ec60 comp rx=0 tx=0).stop 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 -- 172.21.15.167:0/2194469557 reap_dead start 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- 172.21.15.167:0/2194469557 shutdown_connections 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- 172.21.15.167:0/2194469557 >> 172.21.15.167:0/2194469557 conn(0x7fa4540b7250 msgr2=0x7fa4540b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- 172.21.15.167:0/2194469557 shutdown_connections 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- 172.21.15.167:0/2194469557 wait complete. 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 Processor -- start 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- start start 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b56d0 0x7fa4540abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4540ae130 0x7fa454139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa454139860 0x7fa4541e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541455d0 con 0x7fa454139860 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540b5ab0 con 0x7fa4540ae130 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45bc6e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540ad9c0 con 0x7fa4540b56d0 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa454139860 0x7fa4541e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa454139860 0x7fa4541e1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53670/0 (socket says 172.21.15.167:53670) 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 -- 172.21.15.167:0/1304719172 learned_addr learned my addr 172.21.15.167:0/1304719172 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa459209640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4540ae130 0x7fa454139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa459a0a640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b56d0 0x7fa4540abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 -- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b56d0 msgr2=0x7fa4540abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b56d0 0x7fa4540abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 -- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4540ae130 msgr2=0x7fa454139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4540ae130 0x7fa454139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa45a20b640 1 -- 172.21.15.167:0/1304719172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540ac7f0 con 0x7fa454139860 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.041+0000 7fa459a0a640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b56d0 0x7fa4540abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa45a20b640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa454139860 0x7fa4541e1ba0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4540b1750 tx=0x7fa44c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa44a7fc640 1 -- 172.21.15.167:0/1304719172 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c006d60 con 0x7fa454139860 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa44a7fc640 1 -- 172.21.15.167:0/1304719172 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c00de80 con 0x7fa454139860 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4540acbd0 con 0x7fa454139860 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa44a7fc640 1 -- 172.21.15.167:0/1304719172 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c003bc0 con 0x7fa454139860 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4540b6220 con 0x7fa454139860 2024-09-13T17:25:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4540ac650 con 0x7fa454139860 2024-09-13T17:25:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa44a7fc640 1 -- 172.21.15.167:0/1304719172 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa44c005070 con 0x7fa454139860 2024-09-13T17:25:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa44a7fc640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa438066690 0x7fa438068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa459a0a640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa438066690 0x7fa438068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa44a7fc640 1 -- 172.21.15.167:0/1304719172 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa44c084110 con 0x7fa454139860 2024-09-13T17:25:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.045+0000 7fa459a0a640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa438066690 0x7fa438068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa450001ec0 tx=0x7fa450009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.049+0000 7fa44a7fc640 1 -- 172.21.15.167:0/1304719172 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4540ac650 con 0x7fa454139860 2024-09-13T17:25:43.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.205+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4540b6410 con 0x7fa438066690 2024-09-13T17:25:43.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.221+0000 7fa44a7fc640 1 -- 172.21.15.167:0/1304719172 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369458 (secure 0 0 0) 0x7fa4540b6410 con 0x7fa438066690 2024-09-13T17:25:43.230 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:25:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:25:43.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa438066690 msgr2=0x7fa438068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa438066690 0x7fa438068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa450001ec0 tx=0x7fa450009040 comp rx=0 tx=0).stop 2024-09-13T17:25:43.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa454139860 msgr2=0x7fa4541e1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa454139860 0x7fa4541e1ba0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4540b1750 tx=0x7fa44c00db40 comp rx=0 tx=0).stop 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 shutdown_connections 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fa438066690 0x7fa438068b50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa454139860 0x7fa4541e1ba0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4540ae130 0x7fa454139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 --2- 172.21.15.167:0/1304719172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4540b56d0 0x7fa4540abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.225+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 >> 172.21.15.167:0/1304719172 conn(0x7fa4540b7250 msgr2=0x7fa45413a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.229+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 shutdown_connections 2024-09-13T17:25:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:25:43.229+0000 7fa45bc6e640 1 -- 172.21.15.167:0/1304719172 wait complete. 2024-09-13T17:25:43.248 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-09-13T17:25:41.594122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1417001,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":122,"num_write":318,"num_write_kb":3307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":889,"ondisk_log_size":889,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229552,"kb_used_data":5232,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754745168,"statfs":{"total":773094113280,"available":772859052032,"internally_reserved":0,"allocated":5357568,"data_stored":3827034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":229625402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005193"},"pg_stats":[{"pgid":"2.1f","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.628537+0000","last_change":"2024-09-13T17:25:02.628537+0000","last_active":"2024-09-13T17:25:02.628537+0000","last_peered":"2024-09-13T17:25:02.628537+0000","last_clean":"2024-09-13T17:25:02.628537+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:25:02.628537+0000","last_undegraded":"2024-09-13T17:25:02.628537+0000","last_fullsized":"2024-09-13T17:25:02.628537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.628245+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:24.649049+0000","scrub_duration":0.0070116220000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.704444+0000","last_change":"2024-09-13T17:25:06.704636+0000","last_active":"2024-09-13T17:25:06.704444+0000","last_peered":"2024-09-13T17:25:06.704444+0000","last_clean":"2024-09-13T17:25:06.704444+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:25:06.704444+0000","last_undegraded":"2024-09-13T17:25:06.704444+0000","last_fullsized":"2024-09-13T17:25:06.704444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.704389+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:51.558080+0000","scrub_duration":0.003418436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.555827+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:23:23.555827+0000","last_peered":"2024-09-13T17:23:23.555827+0000","last_clean":"2024-09-13T17:23:23.555827+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:23:23.555827+0000","last_undegraded":"2024-09-13T17:23:23.555827+0000","last_fullsized":"2024-09-13T17:23:23.555827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.780000+0000","last_change":"2024-09-13T17:25:25.780196+0000","last_active":"2024-09-13T17:25:25.780000+0000","last_peered":"2024-09-13T17:25:25.780000+0000","last_clean":"2024-09-13T17:25:25.780000+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:25:25.780000+0000","last_undegraded":"2024-09-13T17:25:25.780000+0000","last_fullsized":"2024-09-13T17:25:25.780000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:25.779949+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:25.779949+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.779949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:29.384897+0000","scrub_duration":0.0031370510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.696402+0000","last_change":"2024-09-13T17:25:22.696483+0000","last_active":"2024-09-13T17:25:22.696402+0000","last_peered":"2024-09-13T17:25:22.696402+0000","last_clean":"2024-09-13T17:25:22.696402+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:25:22.696402+0000","last_undegraded":"2024-09-13T17:25:22.696402+0000","last_fullsized":"2024-09-13T17:25:22.696402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:22.696381+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:22.696381+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.696381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:05.788737+0000","scrub_duration":0.001792341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.219261+0000","last_change":"2024-09-13T17:25:31.219599+0000","last_active":"2024-09-13T17:25:31.219261+0000","last_peered":"2024-09-13T17:25:31.219261+0000","last_clean":"2024-09-13T17:25:31.219261+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:25:31.219261+0000","last_undegraded":"2024-09-13T17:25:31.219261+0000","last_fullsized":"2024-09-13T17:25:31.219261+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:31.219211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:31.219211+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.219211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:34.824159+0000","scrub_duration":0.003885725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.409450+0000","last_change":"2024-09-13T17:25:24.409651+0000","last_active":"2024-09-13T17:25:24.409450+0000","last_peered":"2024-09-13T17:25:24.409450+0000","last_clean":"2024-09-13T17:25:24.409450+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:25:24.409450+0000","last_undegraded":"2024-09-13T17:25:24.409450+0000","last_fullsized":"2024-09-13T17:25:24.409450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:24.409395+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:24.409395+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.409395+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:26.545296+0000","scrub_duration":0.005542936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:38.067977+0000","last_change":"2024-09-13T17:25:38.068169+0000","last_active":"2024-09-13T17:25:38.067977+0000","last_peered":"2024-09-13T17:25:38.067977+0000","last_clean":"2024-09-13T17:25:38.067977+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:25:38.067977+0000","last_undegraded":"2024-09-13T17:25:38.067977+0000","last_fullsized":"2024-09-13T17:25:38.067977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:38.067923+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:38.067923+0000","last_clean_scrub_stamp":"2024-09-13T17:25:38.067923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:01.927744+0000","scrub_duration":0.0029584210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:28.556722+0000","last_change":"2024-09-13T17:20:55.008779+0000","last_active":"2024-09-13T17:23:28.556722+0000","last_peered":"2024-09-13T17:23:28.556722+0000","last_clean":"2024-09-13T17:23:28.556722+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:23:28.556722+0000","last_undegraded":"2024-09-13T17:23:28.556722+0000","last_fullsized":"2024-09-13T17:23:28.556722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:08.412481+0000","last_change":"2024-09-13T17:25:08.412674+0000","last_active":"2024-09-13T17:25:08.412481+0000","last_peered":"2024-09-13T17:25:08.412481+0000","last_clean":"2024-09-13T17:25:08.412481+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:25:08.412481+0000","last_undegraded":"2024-09-13T17:25:08.412481+0000","last_fullsized":"2024-09-13T17:25:08.412481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_clean_scrub_stamp":"2024-09-13T17:25:08.412427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:29.772409+0000","scrub_duration":0.0057650419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'14","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.777127+0000","last_change":"2024-09-13T17:20:50.988082+0000","last_active":"2024-09-13T17:24:55.777127+0000","last_peered":"2024-09-13T17:24:55.777127+0000","last_clean":"2024-09-13T17:24:55.777127+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:24:55.777127+0000","last_undegraded":"2024-09-13T17:24:55.777127+0000","last_fullsized":"2024-09-13T17:24:55.777127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:26.246401+0000","last_change":"2024-09-13T17:25:26.246696+0000","last_active":"2024-09-13T17:25:26.246401+0000","last_peered":"2024-09-13T17:25:26.246401+0000","last_clean":"2024-09-13T17:25:26.246401+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:25:26.246401+0000","last_undegraded":"2024-09-13T17:25:26.246401+0000","last_fullsized":"2024-09-13T17:25:26.246401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:26.246350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:26.246350+0000","last_clean_scrub_stamp":"2024-09-13T17:25:26.246350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:16.980006+0000","scrub_duration":0.0034657339999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.803124+0000","last_change":"2024-09-13T17:25:25.803314+0000","last_active":"2024-09-13T17:25:25.803124+0000","last_peered":"2024-09-13T17:25:25.803124+0000","last_clean":"2024-09-13T17:25:25.803124+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:25:25.803124+0000","last_undegraded":"2024-09-13T17:25:25.803124+0000","last_fullsized":"2024-09-13T17:25:25.803124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:25.803067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:25.803067+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.803067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:27.938969+0000","scrub_duration":0.0029319709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.413865+0000","last_change":"2024-09-13T17:25:17.413865+0000","last_active":"2024-09-13T17:25:17.413865+0000","last_peered":"2024-09-13T17:25:17.413865+0000","last_clean":"2024-09-13T17:25:17.413865+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:25:17.413865+0000","last_undegraded":"2024-09-13T17:25:17.413865+0000","last_fullsized":"2024-09-13T17:25:17.413865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.413598+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:25.054898+0000","scrub_duration":0.0059348559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.181066+0000","last_change":"2024-09-13T17:25:37.181333+0000","last_active":"2024-09-13T17:25:37.181066+0000","last_peered":"2024-09-13T17:25:37.181066+0000","last_clean":"2024-09-13T17:25:37.181066+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:25:37.181066+0000","last_undegraded":"2024-09-13T17:25:37.181066+0000","last_fullsized":"2024-09-13T17:25:37.181066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:37.181014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:37.181014+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.181014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:01.040835+0000","scrub_duration":0.0037858309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.698823+0000","last_change":"2024-09-13T17:25:04.698823+0000","last_active":"2024-09-13T17:25:04.698823+0000","last_peered":"2024-09-13T17:25:04.698823+0000","last_clean":"2024-09-13T17:25:04.698823+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:25:04.698823+0000","last_undegraded":"2024-09-13T17:25:04.698823+0000","last_fullsized":"2024-09-13T17:25:04.698823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.698582+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:43.902693+0000","scrub_duration":0.0032068940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.218192+0000","last_change":"2024-09-13T17:25:14.218382+0000","last_active":"2024-09-13T17:25:14.218192+0000","last_peered":"2024-09-13T17:25:14.218192+0000","last_clean":"2024-09-13T17:25:14.218192+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:25:14.218192+0000","last_undegraded":"2024-09-13T17:25:14.218192+0000","last_fullsized":"2024-09-13T17:25:14.218192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.218137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:53.422249+0000","scrub_duration":0.002748159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.806852+0000","last_change":"2024-09-13T17:20:55.005684+0000","last_active":"2024-09-13T17:25:00.806852+0000","last_peered":"2024-09-13T17:25:00.806852+0000","last_clean":"2024-09-13T17:25:00.806852+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:25:00.806852+0000","last_undegraded":"2024-09-13T17:25:00.806852+0000","last_fullsized":"2024-09-13T17:25:00.806852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.782532+0000","last_change":"2024-09-13T17:25:30.782767+0000","last_active":"2024-09-13T17:25:30.782532+0000","last_peered":"2024-09-13T17:25:30.782532+0000","last_clean":"2024-09-13T17:25:30.782532+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:25:30.782532+0000","last_undegraded":"2024-09-13T17:25:30.782532+0000","last_fullsized":"2024-09-13T17:25:30.782532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:30.782478+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:30.782478+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.782478+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:37.562271+0000","scrub_duration":0.0034837280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.208492+0000","last_change":"2024-09-13T17:25:02.208492+0000","last_active":"2024-09-13T17:25:02.208492+0000","last_peered":"2024-09-13T17:25:02.208492+0000","last_clean":"2024-09-13T17:25:02.208492+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:25:02.208492+0000","last_undegraded":"2024-09-13T17:25:02.208492+0000","last_fullsized":"2024-09-13T17:25:02.208492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.208341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:23.568323+0000","scrub_duration":0.0022388500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.451050+0000","last_change":"2024-09-13T17:20:55.189044+0000","last_active":"2024-09-13T17:24:59.451050+0000","last_peered":"2024-09-13T17:24:59.451050+0000","last_clean":"2024-09-13T17:24:59.451050+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:24:59.451050+0000","last_undegraded":"2024-09-13T17:24:59.451050+0000","last_fullsized":"2024-09-13T17:24:59.451050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.203514+0000","last_change":"2024-09-13T17:25:07.203514+0000","last_active":"2024-09-13T17:25:07.203514+0000","last_peered":"2024-09-13T17:25:07.203514+0000","last_clean":"2024-09-13T17:25:07.203514+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:25:07.203514+0000","last_undegraded":"2024-09-13T17:25:07.203514+0000","last_fullsized":"2024-09-13T17:25:07.203514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.203223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:55.648120+0000","scrub_duration":0.0035296839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.406368+0000","last_change":"2024-09-13T17:25:25.406554+0000","last_active":"2024-09-13T17:25:25.406368+0000","last_peered":"2024-09-13T17:25:25.406368+0000","last_clean":"2024-09-13T17:25:25.406368+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:25:25.406368+0000","last_undegraded":"2024-09-13T17:25:25.406368+0000","last_fullsized":"2024-09-13T17:25:25.406368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:25.406316+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:25.406316+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.406316+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:47.268848+0000","scrub_duration":0.0033269950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:35.177036+0000","last_change":"2024-09-13T17:25:35.177303+0000","last_active":"2024-09-13T17:25:35.177036+0000","last_peered":"2024-09-13T17:25:35.177036+0000","last_clean":"2024-09-13T17:25:35.177036+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:25:35.177036+0000","last_undegraded":"2024-09-13T17:25:35.177036+0000","last_fullsized":"2024-09-13T17:25:35.177036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:35.176983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:35.176983+0000","last_clean_scrub_stamp":"2024-09-13T17:25:35.176983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:20.094265+0000","scrub_duration":0.0034760569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.671539+0000","last_change":"2024-09-13T17:25:15.671748+0000","last_active":"2024-09-13T17:25:15.671539+0000","last_peered":"2024-09-13T17:25:15.671539+0000","last_clean":"2024-09-13T17:25:15.671539+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:25:15.671539+0000","last_undegraded":"2024-09-13T17:25:15.671539+0000","last_fullsized":"2024-09-13T17:25:15.671539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.671487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.525179+0000","scrub_duration":0.0032178739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.817097+0000","last_change":"2024-09-13T17:25:07.817097+0000","last_active":"2024-09-13T17:25:07.817097+0000","last_peered":"2024-09-13T17:25:07.817097+0000","last_clean":"2024-09-13T17:25:07.817097+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:25:07.817097+0000","last_undegraded":"2024-09-13T17:25:07.817097+0000","last_fullsized":"2024-09-13T17:25:07.817097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.816834+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:51.570981+0000","scrub_duration":0.005827853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.806803+0000","last_change":"2024-09-13T17:20:55.195031+0000","last_active":"2024-09-13T17:25:00.806803+0000","last_peered":"2024-09-13T17:25:00.806803+0000","last_clean":"2024-09-13T17:25:00.806803+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:25:00.806803+0000","last_undegraded":"2024-09-13T17:25:00.806803+0000","last_fullsized":"2024-09-13T17:25:00.806803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.845728+0000","last_change":"2024-09-13T17:25:34.845919+0000","last_active":"2024-09-13T17:25:34.845728+0000","last_peered":"2024-09-13T17:25:34.845728+0000","last_clean":"2024-09-13T17:25:34.845728+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:25:34.845728+0000","last_undegraded":"2024-09-13T17:25:34.845728+0000","last_fullsized":"2024-09-13T17:25:34.845728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:34.845678+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:34.845678+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.845678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:33.702430+0000","scrub_duration":0.0033246199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'23","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.112478+0000","last_change":"2024-09-13T17:25:18.112726+0000","last_active":"2024-09-13T17:25:18.112478+0000","last_peered":"2024-09-13T17:25:18.112478+0000","last_clean":"2024-09-13T17:25:18.112478+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:25:18.112478+0000","last_undegraded":"2024-09-13T17:25:18.112478+0000","last_fullsized":"2024-09-13T17:25:18.112478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.112416+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:20.248318+0000","scrub_duration":0.0039924269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:58.570143+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:24:58.570143+0000","last_peered":"2024-09-13T17:24:58.570143+0000","last_clean":"2024-09-13T17:24:58.570143+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:24:58.570143+0000","last_undegraded":"2024-09-13T17:24:58.570143+0000","last_fullsized":"2024-09-13T17:24:58.570143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:21.165184+0000","last_change":"2024-09-13T17:25:21.165461+0000","last_active":"2024-09-13T17:25:21.165184+0000","last_peered":"2024-09-13T17:25:21.165184+0000","last_clean":"2024-09-13T17:25:21.165184+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:25:21.165184+0000","last_undegraded":"2024-09-13T17:25:21.165184+0000","last_fullsized":"2024-09-13T17:25:21.165184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:21.165127+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:21.165127+0000","last_clean_scrub_stamp":"2024-09-13T17:25:21.165127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:59.258109+0000","scrub_duration":0.003019346,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.386132+0000","last_change":"2024-09-13T17:25:22.386379+0000","last_active":"2024-09-13T17:25:22.386132+0000","last_peered":"2024-09-13T17:25:22.386132+0000","last_clean":"2024-09-13T17:25:22.386132+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:25:22.386132+0000","last_undegraded":"2024-09-13T17:25:22.386132+0000","last_fullsized":"2024-09-13T17:25:22.386132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:22.386078+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:22.386078+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.386078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:07.239770+0000","scrub_duration":0.0037360340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.687521+0000","last_change":"2024-09-13T17:25:37.687860+0000","last_active":"2024-09-13T17:25:37.687521+0000","last_peered":"2024-09-13T17:25:37.687521+0000","last_clean":"2024-09-13T17:25:37.687521+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:25:37.687521+0000","last_undegraded":"2024-09-13T17:25:37.687521+0000","last_fullsized":"2024-09-13T17:25:37.687521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:37.687465+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:37.687465+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.687465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:36.544217+0000","scrub_duration":0.0033668270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.038288+0000","last_change":"2024-09-13T17:25:37.038483+0000","last_active":"2024-09-13T17:25:37.038288+0000","last_peered":"2024-09-13T17:25:37.038288+0000","last_clean":"2024-09-13T17:25:37.038288+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:25:37.038288+0000","last_undegraded":"2024-09-13T17:25:37.038288+0000","last_fullsized":"2024-09-13T17:25:37.038288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:37.038236+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:37.038236+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.038236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:43.818029+0000","scrub_duration":0.0033362869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:16.154785+0000","last_change":"2024-09-13T17:25:16.154988+0000","last_active":"2024-09-13T17:25:16.154785+0000","last_peered":"2024-09-13T17:25:16.154785+0000","last_clean":"2024-09-13T17:25:16.154785+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:25:16.154785+0000","last_undegraded":"2024-09-13T17:25:16.154785+0000","last_fullsized":"2024-09-13T17:25:16.154785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_clean_scrub_stamp":"2024-09-13T17:25:16.154736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:01.008428+0000","scrub_duration":0.0028624710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.002580+0000","last_change":"2024-09-13T17:25:33.002847+0000","last_active":"2024-09-13T17:25:33.002580+0000","last_peered":"2024-09-13T17:25:33.002580+0000","last_clean":"2024-09-13T17:25:33.002580+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:25:33.002580+0000","last_undegraded":"2024-09-13T17:25:33.002580+0000","last_fullsized":"2024-09-13T17:25:33.002580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.002518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.002518+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.002518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:39.782311+0000","scrub_duration":0.0035369780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.168785+0000","last_change":"2024-09-13T17:25:10.169043+0000","last_active":"2024-09-13T17:25:10.168785+0000","last_peered":"2024-09-13T17:25:10.168785+0000","last_clean":"2024-09-13T17:25:10.168785+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:25:10.168785+0000","last_undegraded":"2024-09-13T17:25:10.168785+0000","last_fullsized":"2024-09-13T17:25:10.168785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.168724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:49.372835+0000","scrub_duration":0.003603452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.184229+0000","last_change":"2024-09-13T17:25:18.184475+0000","last_active":"2024-09-13T17:25:18.184229+0000","last_peered":"2024-09-13T17:25:18.184229+0000","last_clean":"2024-09-13T17:25:18.184229+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:25:18.184229+0000","last_undegraded":"2024-09-13T17:25:18.184229+0000","last_fullsized":"2024-09-13T17:25:18.184229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.184172+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:57.388284+0000","scrub_duration":0.0032424060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.005026+0000","last_change":"2024-09-13T17:25:36.005321+0000","last_active":"2024-09-13T17:25:36.005026+0000","last_peered":"2024-09-13T17:25:36.005026+0000","last_clean":"2024-09-13T17:25:36.005026+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:25:36.005026+0000","last_undegraded":"2024-09-13T17:25:36.005026+0000","last_fullsized":"2024-09-13T17:25:36.005026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-13T17:25:36.004968+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-13T17:25:36.004968+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.004968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:52.687137+0000","scrub_duration":0.003791296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.184865+0000","last_change":"2024-09-13T17:25:23.185129+0000","last_active":"2024-09-13T17:25:23.184865+0000","last_peered":"2024-09-13T17:25:23.184865+0000","last_clean":"2024-09-13T17:25:23.184865+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:25:23.184865+0000","last_undegraded":"2024-09-13T17:25:23.184865+0000","last_fullsized":"2024-09-13T17:25:23.184865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:23.184812+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:23.184812+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.184812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:06.277168+0000","scrub_duration":0.003350563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'21","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.476799+0000","last_change":"2024-09-13T17:25:07.476991+0000","last_active":"2024-09-13T17:25:07.476799+0000","last_peered":"2024-09-13T17:25:07.476799+0000","last_clean":"2024-09-13T17:25:07.476799+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:25:07.476799+0000","last_undegraded":"2024-09-13T17:25:07.476799+0000","last_fullsized":"2024-09-13T17:25:07.476799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.476745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.046686+0000","scrub_duration":0.0038459200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":15,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.974688+0000","last_change":"2024-09-13T17:25:33.974929+0000","last_active":"2024-09-13T17:25:33.974688+0000","last_peered":"2024-09-13T17:25:33.974688+0000","last_clean":"2024-09-13T17:25:33.974688+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:25:33.974688+0000","last_undegraded":"2024-09-13T17:25:33.974688+0000","last_fullsized":"2024-09-13T17:25:33.974688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.974638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.974638+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.974638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:57.834459+0000","scrub_duration":0.003720063,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.646784+0000","last_change":"2024-09-13T17:25:10.647013+0000","last_active":"2024-09-13T17:25:10.646784+0000","last_peered":"2024-09-13T17:25:10.646784+0000","last_clean":"2024-09-13T17:25:10.646784+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:25:10.646784+0000","last_undegraded":"2024-09-13T17:25:10.646784+0000","last_fullsized":"2024-09-13T17:25:10.646784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.646729+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.288029+0000","scrub_duration":0.0033289930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.383868+0000","last_change":"2024-09-13T17:25:20.384055+0000","last_active":"2024-09-13T17:25:20.383868+0000","last_peered":"2024-09-13T17:25:20.383868+0000","last_clean":"2024-09-13T17:25:20.383868+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:25:20.383868+0000","last_undegraded":"2024-09-13T17:25:20.383868+0000","last_fullsized":"2024-09-13T17:25:20.383868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:20.383810+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:20.383810+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.383810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:59.587921+0000","scrub_duration":0.0033592600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:32.744816+0000","last_change":"2024-09-13T17:25:32.745091+0000","last_active":"2024-09-13T17:25:32.744816+0000","last_peered":"2024-09-13T17:25:32.744816+0000","last_clean":"2024-09-13T17:25:32.744816+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:25:32.744816+0000","last_undegraded":"2024-09-13T17:25:32.744816+0000","last_fullsized":"2024-09-13T17:25:32.744816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:32.744765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:32.744765+0000","last_clean_scrub_stamp":"2024-09-13T17:25:32.744765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:17.662047+0000","scrub_duration":0.0034942660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.672723+0000","last_change":"2024-09-13T17:25:19.672911+0000","last_active":"2024-09-13T17:25:19.672723+0000","last_peered":"2024-09-13T17:25:19.672723+0000","last_clean":"2024-09-13T17:25:19.672723+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:25:19.672723+0000","last_undegraded":"2024-09-13T17:25:19.672723+0000","last_fullsized":"2024-09-13T17:25:19.672723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:19.672673+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:19.672673+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.672673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:02.765029+0000","scrub_duration":0.0034643209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.168094+0000","last_change":"2024-09-13T17:25:19.168291+0000","last_active":"2024-09-13T17:25:19.168094+0000","last_peered":"2024-09-13T17:25:19.168094+0000","last_clean":"2024-09-13T17:25:19.168094+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:25:19.168094+0000","last_undegraded":"2024-09-13T17:25:19.168094+0000","last_fullsized":"2024-09-13T17:25:19.168094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:19.168041+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:19.168041+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.168041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:04.021733+0000","scrub_duration":0.0032097279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.464996+0000","last_change":"2024-09-13T17:25:06.465209+0000","last_active":"2024-09-13T17:25:06.464996+0000","last_peered":"2024-09-13T17:25:06.464996+0000","last_clean":"2024-09-13T17:25:06.464996+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:25:06.464996+0000","last_undegraded":"2024-09-13T17:25:06.464996+0000","last_fullsized":"2024-09-13T17:25:06.464996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.464943+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:50.219090+0000","scrub_duration":0.0095512329999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714768+0000","last_change":"2024-09-13T17:20:55.191738+0000","last_active":"2024-09-13T17:25:01.714768+0000","last_peered":"2024-09-13T17:25:01.714768+0000","last_clean":"2024-09-13T17:25:01.714768+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:25:01.714768+0000","last_undegraded":"2024-09-13T17:25:01.714768+0000","last_fullsized":"2024-09-13T17:25:01.714768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.395641+0000","last_change":"2024-09-13T17:25:29.395850+0000","last_active":"2024-09-13T17:25:29.395641+0000","last_peered":"2024-09-13T17:25:29.395641+0000","last_clean":"2024-09-13T17:25:29.395641+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:25:29.395641+0000","last_undegraded":"2024-09-13T17:25:29.395641+0000","last_fullsized":"2024-09-13T17:25:29.395641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:29.395585+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:29.395585+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.395585+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:12.487941+0000","scrub_duration":0.0033521530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:05.439515+0000","last_change":"2024-09-13T17:25:05.439515+0000","last_active":"2024-09-13T17:25:05.439515+0000","last_peered":"2024-09-13T17:25:05.439515+0000","last_clean":"2024-09-13T17:25:05.439515+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:25:05.439515+0000","last_undegraded":"2024-09-13T17:25:05.439515+0000","last_fullsized":"2024-09-13T17:25:05.439515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_clean_scrub_stamp":"2024-09-13T17:25:05.439251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:16.510107+0000","scrub_duration":0.003462868,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714808+0000","last_change":"2024-09-13T17:20:55.187861+0000","last_active":"2024-09-13T17:25:01.714808+0000","last_peered":"2024-09-13T17:25:01.714808+0000","last_clean":"2024-09-13T17:25:01.714808+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:25:01.714808+0000","last_undegraded":"2024-09-13T17:25:01.714808+0000","last_fullsized":"2024-09-13T17:25:01.714808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.122007+0000","last_change":"2024-09-13T17:25:04.122007+0000","last_active":"2024-09-13T17:25:04.122007+0000","last_peered":"2024-09-13T17:25:04.122007+0000","last_clean":"2024-09-13T17:25:04.122007+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:25:04.122007+0000","last_undegraded":"2024-09-13T17:25:04.122007+0000","last_fullsized":"2024-09-13T17:25:04.122007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.121755+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:47.875902+0000","scrub_duration":0.003354901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.195677+0000","last_change":"2024-09-13T17:25:11.195677+0000","last_active":"2024-09-13T17:25:11.195677+0000","last_peered":"2024-09-13T17:25:11.195677+0000","last_clean":"2024-09-13T17:25:11.195677+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:25:11.195677+0000","last_undegraded":"2024-09-13T17:25:11.195677+0000","last_fullsized":"2024-09-13T17:25:11.195677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.195358+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.836657+0000","scrub_duration":0.0067781489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.720498+0000","last_change":"2024-09-13T17:25:33.720746+0000","last_active":"2024-09-13T17:25:33.720498+0000","last_peered":"2024-09-13T17:25:33.720498+0000","last_clean":"2024-09-13T17:25:33.720498+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:25:33.720498+0000","last_undegraded":"2024-09-13T17:25:33.720498+0000","last_fullsized":"2024-09-13T17:25:33.720498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.720440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.720440+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.720440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:40.500232+0000","scrub_duration":0.0033947959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.160145+0000","last_change":"2024-09-13T17:20:50.999460+0000","last_active":"2024-09-13T17:25:02.160145+0000","last_peered":"2024-09-13T17:25:02.160145+0000","last_clean":"2024-09-13T17:25:02.160145+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:25:02.160145+0000","last_undegraded":"2024-09-13T17:25:02.160145+0000","last_fullsized":"2024-09-13T17:25:02.160145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.438201+0000","last_change":"2024-09-13T17:25:02.438201+0000","last_active":"2024-09-13T17:25:02.438201+0000","last_peered":"2024-09-13T17:25:02.438201+0000","last_clean":"2024-09-13T17:25:02.438201+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:25:02.438201+0000","last_undegraded":"2024-09-13T17:25:02.438201+0000","last_fullsized":"2024-09-13T17:25:02.438201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.438040+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:16.318970+0000","scrub_duration":0.004819215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.242837+0000","last_change":"2024-09-13T17:20:55.191861+0000","last_active":"2024-09-13T17:25:01.242837+0000","last_peered":"2024-09-13T17:25:01.242837+0000","last_clean":"2024-09-13T17:25:01.242837+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:25:01.242837+0000","last_undegraded":"2024-09-13T17:25:01.242837+0000","last_fullsized":"2024-09-13T17:25:01.242837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.495954+0000","last_change":"2024-09-13T17:25:20.496156+0000","last_active":"2024-09-13T17:25:20.495954+0000","last_peered":"2024-09-13T17:25:20.495954+0000","last_clean":"2024-09-13T17:25:20.495954+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:25:20.495954+0000","last_undegraded":"2024-09-13T17:25:20.495954+0000","last_fullsized":"2024-09-13T17:25:20.495954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.495897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:03.053370+0000","scrub_duration":0.0035695599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.150804+0000","last_change":"2024-09-13T17:25:03.150804+0000","last_active":"2024-09-13T17:25:03.150804+0000","last_peered":"2024-09-13T17:25:03.150804+0000","last_clean":"2024-09-13T17:25:03.150804+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:25:03.150804+0000","last_undegraded":"2024-09-13T17:25:03.150804+0000","last_fullsized":"2024-09-13T17:25:03.150804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.150471+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:57.941093+0000","scrub_duration":0.0066500159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.806836+0000","last_change":"2024-09-13T17:20:55.005610+0000","last_active":"2024-09-13T17:25:00.806836+0000","last_peered":"2024-09-13T17:25:00.806836+0000","last_clean":"2024-09-13T17:25:00.806836+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:25:00.806836+0000","last_undegraded":"2024-09-13T17:25:00.806836+0000","last_fullsized":"2024-09-13T17:25:00.806836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.356458+0000","last_change":"2024-09-13T17:25:30.356458+0000","last_active":"2024-09-13T17:25:30.356458+0000","last_peered":"2024-09-13T17:25:30.356458+0000","last_clean":"2024-09-13T17:25:30.356458+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:25:30.356458+0000","last_undegraded":"2024-09-13T17:25:30.356458+0000","last_fullsized":"2024-09-13T17:25:30.356458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:30.356190+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:30.356190+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.356190+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:21.089847+0000","scrub_duration":0.002950341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.415704+0000","last_change":"2024-09-13T17:25:04.415704+0000","last_active":"2024-09-13T17:25:04.415704+0000","last_peered":"2024-09-13T17:25:04.415704+0000","last_clean":"2024-09-13T17:25:04.415704+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:25:04.415704+0000","last_undegraded":"2024-09-13T17:25:04.415704+0000","last_fullsized":"2024-09-13T17:25:04.415704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.415439+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:54.834687+0000","scrub_duration":0.0090550500000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.678422+0000","last_change":"2024-09-13T17:25:34.678670+0000","last_active":"2024-09-13T17:25:34.678422+0000","last_peered":"2024-09-13T17:25:34.678422+0000","last_clean":"2024-09-13T17:25:34.678422+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:25:34.678422+0000","last_undegraded":"2024-09-13T17:25:34.678422+0000","last_fullsized":"2024-09-13T17:25:34.678422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:34.678370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:34.678370+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.678370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:58.538192+0000","scrub_duration":0.003490557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.726333+0000","last_change":"2024-09-13T17:25:23.726333+0000","last_active":"2024-09-13T17:25:23.726333+0000","last_peered":"2024-09-13T17:25:23.726333+0000","last_clean":"2024-09-13T17:25:23.726333+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:25:23.726333+0000","last_undegraded":"2024-09-13T17:25:23.726333+0000","last_fullsized":"2024-09-13T17:25:23.726333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:23.726069+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:23.726069+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.726069+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.579760+0000","scrub_duration":0.0033541109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.731965+0000","last_change":"2024-09-13T17:25:18.731965+0000","last_active":"2024-09-13T17:25:18.731965+0000","last_peered":"2024-09-13T17:25:18.731965+0000","last_clean":"2024-09-13T17:25:18.731965+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:25:18.731965+0000","last_undegraded":"2024-09-13T17:25:18.731965+0000","last_fullsized":"2024-09-13T17:25:18.731965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:18.731534+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:18.731534+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.731534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:26.372834+0000","scrub_duration":0.0032596539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.555986+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:23:23.555986+0000","last_peered":"2024-09-13T17:23:23.555986+0000","last_clean":"2024-09-13T17:23:23.555986+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:23:23.555986+0000","last_undegraded":"2024-09-13T17:23:23.555986+0000","last_fullsized":"2024-09-13T17:23:23.555986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:27.395941+0000","last_change":"2024-09-13T17:25:27.395941+0000","last_active":"2024-09-13T17:25:27.395941+0000","last_peered":"2024-09-13T17:25:27.395941+0000","last_clean":"2024-09-13T17:25:27.395941+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:25:27.395941+0000","last_undegraded":"2024-09-13T17:25:27.395941+0000","last_fullsized":"2024-09-13T17:25:27.395941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-13T17:25:27.395675+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-13T17:25:27.395675+0000","last_clean_scrub_stamp":"2024-09-13T17:25:27.395675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:05.488656+0000","scrub_duration":0.0030620170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.118063+0000","last_change":"2024-09-13T17:25:24.118063+0000","last_active":"2024-09-13T17:25:24.118063+0000","last_peered":"2024-09-13T17:25:24.118063+0000","last_clean":"2024-09-13T17:25:24.118063+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:25:24.118063+0000","last_undegraded":"2024-09-13T17:25:24.118063+0000","last_fullsized":"2024-09-13T17:25:24.118063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:24.117812+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:24.117812+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.117812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:07.420171+0000","scrub_duration":0.003376834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357921+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:25:00.357921+0000","last_peered":"2024-09-13T17:25:00.357921+0000","last_clean":"2024-09-13T17:25:00.357921+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:25:00.357921+0000","last_undegraded":"2024-09-13T17:25:00.357921+0000","last_fullsized":"2024-09-13T17:25:00.357921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.669681+0000","last_change":"2024-09-13T17:25:13.669681+0000","last_active":"2024-09-13T17:25:13.669681+0000","last_peered":"2024-09-13T17:25:13.669681+0000","last_clean":"2024-09-13T17:25:13.669681+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:25:13.669681+0000","last_undegraded":"2024-09-13T17:25:13.669681+0000","last_fullsized":"2024-09-13T17:25:13.669681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.669441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:52.873552+0000","scrub_duration":0.0032794059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.611938+0000","last_change":"2024-09-13T17:24:59.611938+0000","last_active":"2024-09-13T17:24:59.611938+0000","last_peered":"2024-09-13T17:24:59.611938+0000","last_clean":"2024-09-13T17:24:59.611938+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:24:59.611938+0000","last_undegraded":"2024-09-13T17:24:59.611938+0000","last_fullsized":"2024-09-13T17:24:59.611938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_clean_scrub_stamp":"2024-09-13T17:24:59.611848+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:43.365995+0000","scrub_duration":0.0050935939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:23.561925+0000","last_change":"2024-09-13T17:20:55.192325+0000","last_active":"2024-09-13T17:23:23.561925+0000","last_peered":"2024-09-13T17:23:23.561925+0000","last_clean":"2024-09-13T17:23:23.561925+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:23:23.561925+0000","last_undegraded":"2024-09-13T17:23:23.561925+0000","last_fullsized":"2024-09-13T17:23:23.561925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.778261+0000","last_change":"2024-09-13T17:20:50.978242+0000","last_active":"2024-09-13T17:24:55.778261+0000","last_peered":"2024-09-13T17:24:55.778261+0000","last_clean":"2024-09-13T17:24:55.778261+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:24:55.778261+0000","last_undegraded":"2024-09-13T17:24:55.778261+0000","last_fullsized":"2024-09-13T17:24:55.778261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'65","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.813678+0000","last_change":"2024-09-13T17:25:09.813678+0000","last_active":"2024-09-13T17:25:09.813678+0000","last_peered":"2024-09-13T17:25:09.813678+0000","last_clean":"2024-09-13T17:25:09.813678+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:25:09.813678+0000","last_undegraded":"2024-09-13T17:25:09.813678+0000","last_fullsized":"2024-09-13T17:25:09.813678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.813409+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:31.173392+0000","scrub_duration":0.0101034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.965596+0000","last_change":"2024-09-13T17:25:36.965596+0000","last_active":"2024-09-13T17:25:36.965596+0000","last_peered":"2024-09-13T17:25:36.965596+0000","last_clean":"2024-09-13T17:25:36.965596+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:25:36.965596+0000","last_undegraded":"2024-09-13T17:25:36.965596+0000","last_fullsized":"2024-09-13T17:25:36.965596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.965286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.965286+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.965286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:35.822038+0000","scrub_duration":0.0033480490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.217074+0000","last_change":"2024-09-13T17:25:19.217074+0000","last_active":"2024-09-13T17:25:19.217074+0000","last_peered":"2024-09-13T17:25:19.217074+0000","last_clean":"2024-09-13T17:25:19.217074+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:25:19.217074+0000","last_undegraded":"2024-09-13T17:25:19.217074+0000","last_fullsized":"2024-09-13T17:25:19.217074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-13T17:25:19.216760+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-13T17:25:19.216760+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.216760+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:41.079291+0000","scrub_duration":0.002948595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.149058+0000","last_change":"2024-09-13T17:25:19.149356+0000","last_active":"2024-09-13T17:25:19.149058+0000","last_peered":"2024-09-13T17:25:19.149058+0000","last_clean":"2024-09-13T17:25:19.149058+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:25:19.149058+0000","last_undegraded":"2024-09-13T17:25:19.149058+0000","last_fullsized":"2024-09-13T17:25:19.149058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:19.148940+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:19.148940+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.148940+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:41.011472+0000","scrub_duration":0.007088352,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.191338+0000","last_change":"2024-09-13T17:25:36.191338+0000","last_active":"2024-09-13T17:25:36.191338+0000","last_peered":"2024-09-13T17:25:36.191338+0000","last_clean":"2024-09-13T17:25:36.191338+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:25:36.191338+0000","last_undegraded":"2024-09-13T17:25:36.191338+0000","last_fullsized":"2024-09-13T17:25:36.191338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.191036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.191036+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.191036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.970828+0000","scrub_duration":0.0035775889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.527098+0000","last_change":"2024-09-13T17:25:19.527297+0000","last_active":"2024-09-13T17:25:19.527098+0000","last_peered":"2024-09-13T17:25:19.527098+0000","last_clean":"2024-09-13T17:25:19.527098+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:25:19.527098+0000","last_undegraded":"2024-09-13T17:25:19.527098+0000","last_fullsized":"2024-09-13T17:25:19.527098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.527040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:23.337212+0000","scrub_duration":0.0035432609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.127455+0000","last_change":"2024-09-13T17:25:22.127641+0000","last_active":"2024-09-13T17:25:22.127455+0000","last_peered":"2024-09-13T17:25:22.127455+0000","last_clean":"2024-09-13T17:25:22.127455+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:25:22.127455+0000","last_undegraded":"2024-09-13T17:25:22.127455+0000","last_fullsized":"2024-09-13T17:25:22.127455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:22.127400+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:22.127400+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.127400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:24.263302+0000","scrub_duration":0.0030192029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.358121+0000","last_change":"2024-09-13T17:20:54.994403+0000","last_active":"2024-09-13T17:25:00.358121+0000","last_peered":"2024-09-13T17:25:00.358121+0000","last_clean":"2024-09-13T17:25:00.358121+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:25:00.358121+0000","last_undegraded":"2024-09-13T17:25:00.358121+0000","last_fullsized":"2024-09-13T17:25:00.358121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.088082+0000","last_change":"2024-09-13T17:25:07.088281+0000","last_active":"2024-09-13T17:25:07.088082+0000","last_peered":"2024-09-13T17:25:07.088082+0000","last_clean":"2024-09-13T17:25:07.088082+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:25:07.088082+0000","last_undegraded":"2024-09-13T17:25:07.088082+0000","last_fullsized":"2024-09-13T17:25:07.088082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.088022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:29.108827+0000","scrub_duration":0.0031517120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:21.770606+0000","last_change":"2024-09-13T17:25:21.770806+0000","last_active":"2024-09-13T17:25:21.770606+0000","last_peered":"2024-09-13T17:25:21.770606+0000","last_clean":"2024-09-13T17:25:21.770606+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:25:21.770606+0000","last_undegraded":"2024-09-13T17:25:21.770606+0000","last_fullsized":"2024-09-13T17:25:21.770606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:21.770544+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:21.770544+0000","last_clean_scrub_stamp":"2024-09-13T17:25:21.770544+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:00.974655+0000","scrub_duration":0.0030705950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357967+0000","last_change":"2024-09-13T17:20:55.189980+0000","last_active":"2024-09-13T17:25:00.357967+0000","last_peered":"2024-09-13T17:25:00.357967+0000","last_clean":"2024-09-13T17:25:00.357967+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:25:00.357967+0000","last_undegraded":"2024-09-13T17:25:00.357967+0000","last_fullsized":"2024-09-13T17:25:00.357967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.733330+0000","last_change":"2024-09-13T17:25:36.733570+0000","last_active":"2024-09-13T17:25:36.733330+0000","last_peered":"2024-09-13T17:25:36.733330+0000","last_clean":"2024-09-13T17:25:36.733330+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:25:36.733330+0000","last_undegraded":"2024-09-13T17:25:36.733330+0000","last_fullsized":"2024-09-13T17:25:36.733330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.733273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.733273+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.733273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:53.415442+0000","scrub_duration":0.0032446570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.248575+0000","last_change":"2024-09-13T17:25:00.248691+0000","last_active":"2024-09-13T17:25:00.248575+0000","last_peered":"2024-09-13T17:25:00.248575+0000","last_clean":"2024-09-13T17:25:00.248575+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:25:00.248575+0000","last_undegraded":"2024-09-13T17:25:00.248575+0000","last_fullsized":"2024-09-13T17:25:00.248575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_clean_scrub_stamp":"2024-09-13T17:25:00.248535+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:44.002682+0000","scrub_duration":0.001465844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.192990+0000","last_change":"2024-09-13T17:25:15.193190+0000","last_active":"2024-09-13T17:25:15.192990+0000","last_peered":"2024-09-13T17:25:15.192990+0000","last_clean":"2024-09-13T17:25:15.192990+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:25:15.192990+0000","last_undegraded":"2024-09-13T17:25:15.192990+0000","last_fullsized":"2024-09-13T17:25:15.192990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.192937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:03.637834+0000","scrub_duration":0.0029227929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.714831+0000","last_change":"2024-09-13T17:20:54.998113+0000","last_active":"2024-09-13T17:25:01.714831+0000","last_peered":"2024-09-13T17:25:01.714831+0000","last_clean":"2024-09-13T17:25:01.714831+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:25:01.714831+0000","last_undegraded":"2024-09-13T17:25:01.714831+0000","last_fullsized":"2024-09-13T17:25:01.714831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.788862+0000","last_change":"2024-09-13T17:25:31.789082+0000","last_active":"2024-09-13T17:25:31.788862+0000","last_peered":"2024-09-13T17:25:31.788862+0000","last_clean":"2024-09-13T17:25:31.788862+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:25:31.788862+0000","last_undegraded":"2024-09-13T17:25:31.788862+0000","last_fullsized":"2024-09-13T17:25:31.788862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:31.788805+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:31.788805+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.788805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:55.648627+0000","scrub_duration":0.0031514809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.776659+0000","last_change":"2024-09-13T17:25:29.776951+0000","last_active":"2024-09-13T17:25:29.776659+0000","last_peered":"2024-09-13T17:25:29.776659+0000","last_clean":"2024-09-13T17:25:29.776659+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:25:29.776659+0000","last_undegraded":"2024-09-13T17:25:29.776659+0000","last_fullsized":"2024-09-13T17:25:29.776659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-13T17:25:29.776603+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-13T17:25:29.776603+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.776603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:14.693884+0000","scrub_duration":0.003380437,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.808936+0000","last_change":"2024-09-13T17:25:04.809132+0000","last_active":"2024-09-13T17:25:04.808936+0000","last_peered":"2024-09-13T17:25:04.808936+0000","last_clean":"2024-09-13T17:25:04.808936+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:25:04.808936+0000","last_undegraded":"2024-09-13T17:25:04.808936+0000","last_fullsized":"2024-09-13T17:25:04.808936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.808880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:50.181093+0000","scrub_duration":0.0030294929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.724340+0000","last_change":"2024-09-13T17:25:17.724560+0000","last_active":"2024-09-13T17:25:17.724340+0000","last_peered":"2024-09-13T17:25:17.724340+0000","last_clean":"2024-09-13T17:25:17.724340+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:25:17.724340+0000","last_undegraded":"2024-09-13T17:25:17.724340+0000","last_fullsized":"2024-09-13T17:25:17.724340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.724289+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:19.860190+0000","scrub_duration":0.003109784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.442800+0000","last_change":"2024-09-13T17:25:14.443046+0000","last_active":"2024-09-13T17:25:14.442800+0000","last_peered":"2024-09-13T17:25:14.442800+0000","last_clean":"2024-09-13T17:25:14.442800+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:25:14.442800+0000","last_undegraded":"2024-09-13T17:25:14.442800+0000","last_fullsized":"2024-09-13T17:25:14.442800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.442749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:47.260752+0000","scrub_duration":0.003699786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.716778+0000","last_change":"2024-09-13T17:25:20.716975+0000","last_active":"2024-09-13T17:25:20.716778+0000","last_peered":"2024-09-13T17:25:20.716778+0000","last_clean":"2024-09-13T17:25:20.716778+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:25:20.716778+0000","last_undegraded":"2024-09-13T17:25:20.716778+0000","last_fullsized":"2024-09-13T17:25:20.716778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:20.716727+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:20.716727+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.716727+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:11.450383+0000","scrub_duration":0.0034162609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:12.189184+0000","last_change":"2024-09-13T17:25:12.189375+0000","last_active":"2024-09-13T17:25:12.189184+0000","last_peered":"2024-09-13T17:25:12.189184+0000","last_clean":"2024-09-13T17:25:12.189184+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:25:12.189184+0000","last_undegraded":"2024-09-13T17:25:12.189184+0000","last_fullsized":"2024-09-13T17:25:12.189184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_clean_scrub_stamp":"2024-09-13T17:25:12.189124+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:57.042815+0000","scrub_duration":0.003516005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:23:28.556549+0000","last_change":"2024-09-13T17:21:32.724190+0000","last_active":"2024-09-13T17:23:28.556549+0000","last_peered":"2024-09-13T17:23:28.556549+0000","last_clean":"2024-09-13T17:23:28.556549+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:23:28.556549+0000","last_undegraded":"2024-09-13T17:23:28.556549+0000","last_fullsized":"2024-09-13T17:23:28.556549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:26.762678+0000","last_change":"2024-09-13T17:25:26.762878+0000","last_active":"2024-09-13T17:25:26.762678+0000","last_peered":"2024-09-13T17:25:26.762678+0000","last_clean":"2024-09-13T17:25:26.762678+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:25:26.762678+0000","last_undegraded":"2024-09-13T17:25:26.762678+0000","last_fullsized":"2024-09-13T17:25:26.762678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:26.762621+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:26.762621+0000","last_clean_scrub_stamp":"2024-09-13T17:25:26.762621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:48.625153+0000","scrub_duration":0.0031858580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.524174+0000","last_change":"2024-09-13T17:25:09.524398+0000","last_active":"2024-09-13T17:25:09.524174+0000","last_peered":"2024-09-13T17:25:09.524174+0000","last_clean":"2024-09-13T17:25:09.524174+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:25:09.524174+0000","last_undegraded":"2024-09-13T17:25:09.524174+0000","last_fullsized":"2024-09-13T17:25:09.524174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.524113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:20.787851+0000","scrub_duration":0.0037612919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.152064+0000","last_change":"2024-09-13T17:25:25.152262+0000","last_active":"2024-09-13T17:25:25.152064+0000","last_peered":"2024-09-13T17:25:25.152064+0000","last_clean":"2024-09-13T17:25:25.152064+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:25:25.152064+0000","last_undegraded":"2024-09-13T17:25:25.152064+0000","last_fullsized":"2024-09-13T17:25:25.152064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:25.152008+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:25.152008+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.152008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:03.244989+0000","scrub_duration":0.0034582440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.722602+0000","last_change":"2024-09-13T17:25:20.722782+0000","last_active":"2024-09-13T17:25:20.722602+0000","last_peered":"2024-09-13T17:25:20.722602+0000","last_clean":"2024-09-13T17:25:20.722602+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:25:20.722602+0000","last_undegraded":"2024-09-13T17:25:20.722602+0000","last_fullsized":"2024-09-13T17:25:20.722602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:20.722540+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:20.722540+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.722540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:58.815521+0000","scrub_duration":0.0028874370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357759+0000","last_change":"2024-09-13T17:20:50.975487+0000","last_active":"2024-09-13T17:25:00.357759+0000","last_peered":"2024-09-13T17:25:00.357759+0000","last_clean":"2024-09-13T17:25:00.357759+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:25:00.357759+0000","last_undegraded":"2024-09-13T17:25:00.357759+0000","last_fullsized":"2024-09-13T17:25:00.357759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.225553+0000","last_change":"2024-09-13T17:25:24.225815+0000","last_active":"2024-09-13T17:25:24.225553+0000","last_peered":"2024-09-13T17:25:24.225553+0000","last_clean":"2024-09-13T17:25:24.225553+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:25:24.225553+0000","last_undegraded":"2024-09-13T17:25:24.225553+0000","last_fullsized":"2024-09-13T17:25:24.225553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:24.225496+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:24.225496+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.225496+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:31.343358+0000","scrub_duration":0.0028727760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'13","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.746949+0000","last_change":"2024-09-13T17:25:31.747141+0000","last_active":"2024-09-13T17:25:31.746949+0000","last_peered":"2024-09-13T17:25:31.746949+0000","last_clean":"2024-09-13T17:25:31.746949+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:25:31.746949+0000","last_undegraded":"2024-09-13T17:25:31.746949+0000","last_fullsized":"2024-09-13T17:25:31.746949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-13T17:25:31.746896+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-13T17:25:31.746896+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.746896+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:22.480553+0000","scrub_duration":0.003164381,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357839+0000","last_change":"2024-09-13T17:20:50.974229+0000","last_active":"2024-09-13T17:25:00.357839+0000","last_peered":"2024-09-13T17:25:00.357839+0000","last_clean":"2024-09-13T17:25:00.357839+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:25:00.357839+0000","last_undegraded":"2024-09-13T17:25:00.357839+0000","last_fullsized":"2024-09-13T17:25:00.357839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.081177+0000","last_change":"2024-09-13T17:25:30.081421+0000","last_active":"2024-09-13T17:25:30.081177+0000","last_peered":"2024-09-13T17:25:30.081177+0000","last_clean":"2024-09-13T17:25:30.081177+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:25:30.081177+0000","last_undegraded":"2024-09-13T17:25:30.081177+0000","last_fullsized":"2024-09-13T17:25:30.081177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:30.081122+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:30.081122+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.081122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:20.814778+0000","scrub_duration":0.0035714520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.650820+0000","last_change":"2024-09-13T17:25:01.650820+0000","last_active":"2024-09-13T17:25:01.650820+0000","last_peered":"2024-09-13T17:25:01.650820+0000","last_clean":"2024-09-13T17:25:01.650820+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:25:01.650820+0000","last_undegraded":"2024-09-13T17:25:01.650820+0000","last_fullsized":"2024-09-13T17:25:01.650820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_clean_scrub_stamp":"2024-09-13T17:25:01.650556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:50.095453+0000","scrub_duration":0.0034189989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'13","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.033260+0000","last_change":"2024-09-13T17:25:31.033560+0000","last_active":"2024-09-13T17:25:31.033260+0000","last_peered":"2024-09-13T17:25:31.033260+0000","last_clean":"2024-09-13T17:25:31.033260+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:25:31.033260+0000","last_undegraded":"2024-09-13T17:25:31.033260+0000","last_fullsized":"2024-09-13T17:25:31.033260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-13T17:25:31.033156+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-13T17:25:31.033156+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.033156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:46.574034+0000","scrub_duration":0.0036197479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:28.758009+0000","last_change":"2024-09-13T17:25:28.758234+0000","last_active":"2024-09-13T17:25:28.758009+0000","last_peered":"2024-09-13T17:25:28.758009+0000","last_clean":"2024-09-13T17:25:28.758009+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:25:28.758009+0000","last_undegraded":"2024-09-13T17:25:28.758009+0000","last_fullsized":"2024-09-13T17:25:28.758009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:28.757955+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:28.757955+0000","last_clean_scrub_stamp":"2024-09-13T17:25:28.757955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:32.362904+0000","scrub_duration":0.0032899600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.771982+0000","last_change":"2024-09-13T17:25:30.772179+0000","last_active":"2024-09-13T17:25:30.771982+0000","last_peered":"2024-09-13T17:25:30.771982+0000","last_clean":"2024-09-13T17:25:30.771982+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:25:30.771982+0000","last_undegraded":"2024-09-13T17:25:30.771982+0000","last_fullsized":"2024-09-13T17:25:30.771982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:30.771929+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:30.771929+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.771929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:13.864285+0000","scrub_duration":0.003260836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.467180+0000","last_change":"2024-09-13T17:25:03.467180+0000","last_active":"2024-09-13T17:25:03.467180+0000","last_peered":"2024-09-13T17:25:03.467180+0000","last_clean":"2024-09-13T17:25:03.467180+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:25:03.467180+0000","last_undegraded":"2024-09-13T17:25:03.467180+0000","last_fullsized":"2024-09-13T17:25:03.467180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.466932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:48.839144+0000","scrub_duration":0.0033368909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'12","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.503305+0000","last_change":"2024-09-13T17:25:11.503305+0000","last_active":"2024-09-13T17:25:11.503305+0000","last_peered":"2024-09-13T17:25:11.503305+0000","last_clean":"2024-09-13T17:25:11.503305+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:25:11.503305+0000","last_undegraded":"2024-09-13T17:25:11.503305+0000","last_fullsized":"2024-09-13T17:25:11.503305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.503041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:37.249276+0000","scrub_duration":0.0030805149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.019638+0000","last_change":"2024-09-13T17:25:36.019834+0000","last_active":"2024-09-13T17:25:36.019638+0000","last_peered":"2024-09-13T17:25:36.019638+0000","last_clean":"2024-09-13T17:25:36.019638+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:25:36.019638+0000","last_undegraded":"2024-09-13T17:25:36.019638+0000","last_fullsized":"2024-09-13T17:25:36.019638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:36.019585+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:36.019585+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.019585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:20.936867+0000","scrub_duration":0.00303558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.007293+0000","last_change":"2024-09-13T17:25:34.007496+0000","last_active":"2024-09-13T17:25:34.007293+0000","last_peered":"2024-09-13T17:25:34.007293+0000","last_clean":"2024-09-13T17:25:34.007293+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:25:34.007293+0000","last_undegraded":"2024-09-13T17:25:34.007293+0000","last_fullsized":"2024-09-13T17:25:34.007293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:34.007235+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:34.007235+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.007235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:26.186363+0000","scrub_duration":0.0034277930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:32.040625+0000","last_change":"2024-09-13T17:25:32.040625+0000","last_active":"2024-09-13T17:25:32.040625+0000","last_peered":"2024-09-13T17:25:32.040625+0000","last_clean":"2024-09-13T17:25:32.040625+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:25:32.040625+0000","last_undegraded":"2024-09-13T17:25:32.040625+0000","last_fullsized":"2024-09-13T17:25:32.040625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:32.040295+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:32.040295+0000","last_clean_scrub_stamp":"2024-09-13T17:25:32.040295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:16.957576+0000","scrub_duration":0.0036150750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.739461+0000","last_change":"2024-09-13T17:25:18.739461+0000","last_active":"2024-09-13T17:25:18.739461+0000","last_peered":"2024-09-13T17:25:18.739461+0000","last_clean":"2024-09-13T17:25:18.739461+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:25:18.739461+0000","last_undegraded":"2024-09-13T17:25:18.739461+0000","last_fullsized":"2024-09-13T17:25:18.739461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:18.739141+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:18.739141+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.739141+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:40.601673+0000","scrub_duration":0.0030483250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.615734+0000","last_change":"2024-09-13T17:25:13.615929+0000","last_active":"2024-09-13T17:25:13.615734+0000","last_peered":"2024-09-13T17:25:13.615734+0000","last_clean":"2024-09-13T17:25:13.615734+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:25:13.615734+0000","last_undegraded":"2024-09-13T17:25:13.615734+0000","last_fullsized":"2024-09-13T17:25:13.615734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.615679+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:35.478210+0000","scrub_duration":0.0034373250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.269324+0000","last_change":"2024-09-13T17:25:25.269523+0000","last_active":"2024-09-13T17:25:25.269324+0000","last_peered":"2024-09-13T17:25:25.269324+0000","last_clean":"2024-09-13T17:25:25.269324+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:25:25.269324+0000","last_undegraded":"2024-09-13T17:25:25.269324+0000","last_fullsized":"2024-09-13T17:25:25.269324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:25.269269+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:25.269269+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:08.361626+0000","scrub_duration":0.0031422120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:28.746262+0000","last_change":"2024-09-13T17:25:28.746464+0000","last_active":"2024-09-13T17:25:28.746262+0000","last_peered":"2024-09-13T17:25:28.746262+0000","last_clean":"2024-09-13T17:25:28.746262+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:25:28.746262+0000","last_undegraded":"2024-09-13T17:25:28.746262+0000","last_fullsized":"2024-09-13T17:25:28.746262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:28.746208+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:28.746208+0000","last_clean_scrub_stamp":"2024-09-13T17:25:28.746208+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:06.839190+0000","scrub_duration":0.0032046969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.724221+0000","last_change":"2024-09-13T17:25:36.724481+0000","last_active":"2024-09-13T17:25:36.724221+0000","last_peered":"2024-09-13T17:25:36.724221+0000","last_clean":"2024-09-13T17:25:36.724221+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:25:36.724221+0000","last_undegraded":"2024-09-13T17:25:36.724221+0000","last_fullsized":"2024-09-13T17:25:36.724221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:36.724160+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:36.724160+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.724160+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:40.329109+0000","scrub_duration":0.0028934709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'9","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780544+0000","last_change":"2024-09-13T17:20:50.999465+0000","last_active":"2024-09-13T17:24:55.780544+0000","last_peered":"2024-09-13T17:24:55.780544+0000","last_clean":"2024-09-13T17:24:55.780544+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:24:55.780544+0000","last_undegraded":"2024-09-13T17:24:55.780544+0000","last_fullsized":"2024-09-13T17:24:55.780544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.804182+0000","last_change":"2024-09-13T17:25:33.804445+0000","last_active":"2024-09-13T17:25:33.804182+0000","last_peered":"2024-09-13T17:25:33.804182+0000","last_clean":"2024-09-13T17:25:33.804182+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:25:33.804182+0000","last_undegraded":"2024-09-13T17:25:33.804182+0000","last_fullsized":"2024-09-13T17:25:33.804182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:33.804129+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:33.804129+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.804129+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:50.486298+0000","scrub_duration":0.0035316409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:35.355448+0000","last_change":"2024-09-13T17:25:35.355677+0000","last_active":"2024-09-13T17:25:35.355448+0000","last_peered":"2024-09-13T17:25:35.355448+0000","last_clean":"2024-09-13T17:25:35.355448+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:25:35.355448+0000","last_undegraded":"2024-09-13T17:25:35.355448+0000","last_fullsized":"2024-09-13T17:25:35.355448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:35.355392+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:35.355392+0000","last_clean_scrub_stamp":"2024-09-13T17:25:35.355392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:38.960341+0000","scrub_duration":0.0033666540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'5","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.500116+0000","last_change":"2024-09-13T17:25:17.500315+0000","last_active":"2024-09-13T17:25:17.500116+0000","last_peered":"2024-09-13T17:25:17.500116+0000","last_clean":"2024-09-13T17:25:17.500116+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:25:17.500116+0000","last_undegraded":"2024-09-13T17:25:17.500116+0000","last_fullsized":"2024-09-13T17:25:17.500116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.500012+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:12.784295+0000","scrub_duration":0.0029179330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.780050+0000","last_change":"2024-09-13T17:20:50.998976+0000","last_active":"2024-09-13T17:24:55.780050+0000","last_peered":"2024-09-13T17:24:55.780050+0000","last_clean":"2024-09-13T17:24:55.780050+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:24:55.780050+0000","last_undegraded":"2024-09-13T17:24:55.780050+0000","last_fullsized":"2024-09-13T17:24:55.780050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:55.775799+0000","last_change":"2024-09-13T17:20:50.972972+0000","last_active":"2024-09-13T17:24:55.775799+0000","last_peered":"2024-09-13T17:24:55.775799+0000","last_clean":"2024-09-13T17:24:55.775799+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:24:55.775799+0000","last_undegraded":"2024-09-13T17:24:55.775799+0000","last_fullsized":"2024-09-13T17:24:55.775799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.720252+0000","last_change":"2024-09-13T17:25:23.720480+0000","last_active":"2024-09-13T17:25:23.720252+0000","last_peered":"2024-09-13T17:25:23.720252+0000","last_clean":"2024-09-13T17:25:23.720252+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:25:23.720252+0000","last_undegraded":"2024-09-13T17:25:23.720252+0000","last_fullsized":"2024-09-13T17:25:23.720252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:23.720199+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:23.720199+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.720199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:14.453855+0000","scrub_duration":0.0029025990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.108525+0000","last_change":"2024-09-13T17:25:29.108723+0000","last_active":"2024-09-13T17:25:29.108525+0000","last_peered":"2024-09-13T17:25:29.108525+0000","last_clean":"2024-09-13T17:25:29.108525+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:25:29.108525+0000","last_undegraded":"2024-09-13T17:25:29.108525+0000","last_fullsized":"2024-09-13T17:25:29.108525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:29.108470+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:29.108470+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.108470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:32.713419+0000","scrub_duration":0.0030366450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'10","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.160565+0000","last_change":"2024-09-13T17:20:50.999212+0000","last_active":"2024-09-13T17:25:02.160565+0000","last_peered":"2024-09-13T17:25:02.160565+0000","last_clean":"2024-09-13T17:25:02.160565+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:25:02.160565+0000","last_undegraded":"2024-09-13T17:25:02.160565+0000","last_fullsized":"2024-09-13T17:25:02.160565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:50.555813+0000","last_clean_scrub_stamp":"2024-09-13T17:20:50.555813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":826633,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":153,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":1653266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.86799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.081,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":1.107},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2150000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.92800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0660000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1379999999999999,"5min":1.216,"15min":1.216},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.84099999999999997},"min":{"1min":0.53900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.526,"15min":1.526},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.752},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.91000000000000003,"15min":0.93799999999999994},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.165,"5min":1.23,"15min":1.23},"last":0.96399999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":1.083},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96699999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.109,"5min":1.365,"15min":1.365},"last":1.1299999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.163},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.167,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.79300000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:24:45 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0720000000000001,"15min":1.1200000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.218,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.88900000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2549999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.024}]}]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1130496,"data_stored":938939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.501,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1140000000000001,"5min":1.167,"15min":1.167},"last":0.88800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.84199999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1379999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0880000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.01}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.875,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.181,"5min":1.615,"15min":1.615},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.268,"15min":1.268},"last":0.95399999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":2.149,"15min":2.149},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98999999999999999,"15min":1.018},"min":{"1min":0.70099999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1200000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.218,"5min":1.367,"15min":1.367},"last":0.749},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0429999999999999,"15min":1.0669999999999999},"min":{"1min":0.68500000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.21,"5min":2.069,"15min":2.069},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.077},"min":{"1min":0.76300000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.2150000000000001,"5min":1.964,"15min":1.964},"last":1.048},{"interface":"front","average":{"1min":0.997,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.73299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.619,"15min":1.619},"last":1.0309999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509502,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.232,"15min":1.232},"last":1.214},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0269999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80200000000000005,"15min":0.84999999999999998},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.84599999999999997,"15min":0.86399999999999999},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.71999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.466,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97299999999999998,"15min":0.997},"min":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.276,"5min":1.339,"15min":1.339},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.97399999999999998,"15min":0.94999999999999996},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.075,"15min":1.1040000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":1.339,"15min":1.339},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.84299999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.127}]},{"osd":7,"last update":"Fri Sep 13 17:24:49 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.129,"15min":1.159},"min":{"1min":0.872,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.256},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0640000000000001,"15min":1.0940000000000001},"min":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0940000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.111,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.873,"15min":0.92700000000000005},"min":{"1min":0.505,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":0.93799999999999994}]},{"osd":1,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0049999999999999,"5min":1.611,"15min":1.611},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78800000000000003,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.88300000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.879},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.1120000000000001,"5min":1.23,"15min":1.23},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90200000000000002,"15min":0.96899999999999997},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1020000000000001,"5min":1.754,"15min":1.754},"last":0.73199999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1990000000000001,"5min":1.268,"15min":1.268},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.92300000000000004,"15min":0.98299999999999998},"min":{"1min":0.68000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.78,"15min":1.78},"last":1.038}]},{"osd":5,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0960000000000001,"5min":1.694,"15min":1.694},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.032,"15min":1.0840000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1399999999999999,"5min":1.907,"15min":1.907},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.97899999999999998,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1299999999999999,"5min":1.53,"15min":1.53},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0509999999999999,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1539999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:24:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.1220000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.137,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.089,"15min":1.147},"min":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1970000000000001,"5min":1.863,"15min":1.863},"last":0.83399999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1142784,"data_stored":949964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.78000000000000003,"5min":1.014,"15min":1.014},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.054,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.503}]},{"osd":1,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.66200000000000003},"min":{"1min":0.32000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.34599999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.93999999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.70499999999999996},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1060000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.71499999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.022,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.02,"5min":1.51,"15min":1.51},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3300000000000001,"5min":1.421,"15min":1.421},"last":1.0700000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.93600000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.61499999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1020000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96799999999999997,"15min":1.01},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.397,"5min":1.712,"15min":1.712},"last":1.022}]},{"osd":7,"last update":"Fri Sep 13 17:24:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3280000000000001,"5min":1.756,"15min":1.756},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94799999999999995,"15min":1.004},"min":{"1min":0.59499999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.248,"5min":1.946,"15min":1.946},"last":1.0469999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.61599999999999999},"min":{"1min":0.26000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.62,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.85199999999999998,"5min":1.466,"15min":1.466},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59399999999999997,"15min":0.622},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95199999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.29699999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.94099999999999995,"5min":1.419,"15min":1.419},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.72199999999999998},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91600000000000004,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.625,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.878,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1020000000000001,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.99199999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91300000000000003,"15min":0.96699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2529999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":0.97999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2669999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3580000000000001,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.141},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95299999999999996,"15min":1.026},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3049999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.96099999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":1.02},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.65000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3400000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.232}]}]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57599999999999996,"15min":0.626},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63800000000000001,"15min":0.66700000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.873,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89400000000000002,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":1.214,"5min":1.401,"15min":1.401},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.877},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.88700000000000001},"min":{"1min":0.57499999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.242}]},{"osd":5,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.266,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88800000000000001,"15min":0.93899999999999995},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2709999999999999,"5min":1.365,"15min":1.365},"last":1.097}]},{"osd":6,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86499999999999999,"15min":0.91700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1870000000000001,"5min":1.323,"15min":1.323},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:24:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.995},"min":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.23,"5min":1.639,"15min":1.639},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92600000000000005,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.528,"15min":1.528},"last":1.163}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":135154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.58899999999999997},"min":{"1min":0.28399999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.60499999999999998},"min":{"1min":0.308,"5min":0.255,"15min":0.255},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83499999999999996,"5min":1.075,"15min":1.075},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.66200000000000003},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.751}]},{"osd":3,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60799999999999998,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.88400000000000001,"5min":1.034,"15min":1.034},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.72999999999999998},"min":{"1min":0.36199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.88200000000000001},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.153,"5min":1.351,"15min":1.351},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0109999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.052}]},{"osd":5,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.878,"15min":0.93799999999999994},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.056,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.087},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1799999999999999,"5min":1.21,"15min":1.21},"last":1.026}]},{"osd":6,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.92200000000000004},"min":{"1min":0.56799999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1359999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.425,"15min":1.425},"last":1.181}]},{"osd":7,"last update":"Fri Sep 13 17:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.127,"5min":1.554,"15min":1.554},"last":1.117},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92100000000000004,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1040000000000001,"5min":1.454,"15min":1.454},"last":1.208}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":814810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:25:43.255 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.256 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.256 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.256 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.256 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.256 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.257 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.257 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.257 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.257 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.257 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.257 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.258 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.258 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.258 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.258 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.258 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.258 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.259 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.259 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.259 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.259 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.259 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.260 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.260 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.260 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T17:20:50.555813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:25:43.260 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:25:52.570 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:25:52.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:03.261 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f585dbe8640 1 Processor -- start 2024-09-13T17:26:03.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f585dbe8640 1 -- start start 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f585dbe8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 0x7f585806cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f585dbe8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f585806c340 0x7f5858150240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f585dbe8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585806c790 con 0x7f5858065ee0 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f585dbe8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585806bc10 con 0x7f585806c340 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f585dbe8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580ad3e0 con 0x7f5858143440 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58577fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5858065ee0 0x7f5858142d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57194/0 (socket says 172.21.15.167:57194) 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58577fe640 1 -- 172.21.15.167:0/1526376554 learned_addr learned my addr 172.21.15.167:0/1526376554 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:26:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5856ffd640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 0x7f585806cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170906901 0 0) 0x7f585806c790 con 0x7f5858065ee0 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5857fff640 1 --2- 172.21.15.167:0/1526376554 >> v2:172.21.15.190:3300/0 conn(0x7f585806c340 0x7f5858150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5844003530 con 0x7f5858065ee0 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3045060365 0 0) 0x7f5844003530 con 0x7f5858065ee0 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 msgr2=0x7f585806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 0x7f585806cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 >> v2:172.21.15.190:3300/0 conn(0x7f585806c340 msgr2=0x7f5858150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 --2- 172.21.15.167:0/1526376554 >> v2:172.21.15.190:3300/0 conn(0x7f585806c340 0x7f5858150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580662c0 con 0x7f5858065ee0 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f5848001680 con 0x7f5858065ee0 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 >> v1:172.21.15.167:6789/0 conn(0x7f5858065ee0 legacy=0x7f5858142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 0x7f5844003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5844003f00 0x7f58440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5844004d10 0x7f5844005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585806bc10 con 0x7f5844004d10 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580ad3e0 con 0x7f5844003f00 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584400b9e0 con 0x7f5858143440 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5857fff640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5844004d10 0x7f5844005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5856ffd640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5844003f00 0x7f58440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f58577fe640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 0x7f5844003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5857fff640 1 -- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 msgr2=0x7f5844003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5857fff640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5858143440 0x7f5844003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5857fff640 1 -- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5844003f00 msgr2=0x7f58440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5857fff640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5844003f00 0x7f58440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.389+0000 7f5857fff640 1 -- 172.21.15.167:0/1526376554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844003530 con 0x7f5844004d10 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f5857fff640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5844004d10 0x7f5844005190 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5850009b10 tx=0x7f585001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5d5318128052e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500a5590 con 0x7f5844004d10 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500a56f0 con 0x7f5844004d10 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f58567fc640 1 -- 172.21.15.167:0/1526376554 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500a5aa0 con 0x7f5844004d10 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 -- 172.21.15.167:0/1526376554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5844004d10 msgr2=0x7f5844005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 --2- 172.21.15.167:0/1526376554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5844004d10 0x7f5844005190 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5850009b10 tx=0x7f585001cab0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f5857fff640 1 -- 172.21.15.167:0/1526376554 reap_dead start 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 -- 172.21.15.167:0/1526376554 shutdown_connections 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 -- 172.21.15.167:0/1526376554 >> 172.21.15.167:0/1526376554 conn(0x7f58580b4560 msgr2=0x7f58580b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 -- 172.21.15.167:0/1526376554 shutdown_connections 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 -- 172.21.15.167:0/1526376554 wait complete. 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 Processor -- start 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.393+0000 7f585dbe8640 1 -- start start 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58581ddf00 0x7f58581da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58580aecc0 0x7f58581dabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58580b12b0 0x7f5858070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58581dec30 con 0x7f58581ddf00 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580b17c0 con 0x7f58580b12b0 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580af150 con 0x7f58580aecc0 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58581ddf00 0x7f58581da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58581ddf00 0x7f58581da6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42312/0 (socket says 172.21.15.167:42312) 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 -- 172.21.15.167:0/1308458713 learned_addr learned my addr 172.21.15.167:0/1308458713 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f5856ffd640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58580aecc0 0x7f58581dabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f5857fff640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58580b12b0 0x7f5858070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 -- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58580aecc0 msgr2=0x7f58581dabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58580aecc0 0x7f58581dabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 -- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58580b12b0 msgr2=0x7f5858070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58580b12b0 0x7f5858070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 -- 172.21.15.167:0/1308458713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585813cb30 con 0x7f58581ddf00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f58577fe640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58581ddf00 0x7f58581da6b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5848004850 tx=0x7f5848011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f584ffff640 1 -- 172.21.15.167:0/1308458713 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800fc20 con 0x7f58581ddf00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f584ffff640 1 -- 172.21.15.167:0/1308458713 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584800fd80 con 0x7f58581ddf00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f584ffff640 1 -- 172.21.15.167:0/1308458713 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848015630 con 0x7f58581ddf00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58581de2e0 con 0x7f58581ddf00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58580707a0 con 0x7f58581ddf00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58580af310 con 0x7f58581ddf00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f584ffff640 1 -- 172.21.15.167:0/1308458713 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5848015790 con 0x7f58581ddf00 2024-09-13T17:26:03.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f584ffff640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5838066690 0x7f5838068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f5856ffd640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5838066690 0x7f5838068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f584ffff640 1 -- 172.21.15.167:0/1308458713 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5848087750 con 0x7f58581ddf00 2024-09-13T17:26:03.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.397+0000 7f5856ffd640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5838066690 0x7f5838068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58580711e0 tx=0x7f584000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:03.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.401+0000 7f584ffff640 1 -- 172.21.15.167:0/1308458713 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5848054820 con 0x7f58581ddf00 2024-09-13T17:26:03.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.557+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58580ad060 con 0x7f5838066690 2024-09-13T17:26:03.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.581+0000 7f584ffff640 1 -- 172.21.15.167:0/1308458713 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370704 (secure 0 0 0) 0x7f584000f040 con 0x7f5838066690 2024-09-13T17:26:03.590 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:26:03.593 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:26:03.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5838066690 msgr2=0x7f5838068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5838066690 0x7f5838068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58580711e0 tx=0x7f584000b040 comp rx=0 tx=0).stop 2024-09-13T17:26:03.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58581ddf00 msgr2=0x7f58581da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58581ddf00 0x7f58581da6b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5848004850 tx=0x7f5848011de0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 shutdown_connections 2024-09-13T17:26:03.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5838066690 0x7f5838068b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58580b12b0 0x7f5858070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58580aecc0 0x7f58581dabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 --2- 172.21.15.167:0/1308458713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58581ddf00 0x7f58581da6b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 >> 172.21.15.167:0/1308458713 conn(0x7f58580b4560 msgr2=0x7f58581421d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:03.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.585+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 shutdown_connections 2024-09-13T17:26:03.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:03.589+0000 7f585dbe8640 1 -- 172.21.15.167:0/1308458713 wait complete. 2024-09-13T17:26:03.608 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-09-13T17:26:01.602692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1417001,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":122,"num_write":318,"num_write_kb":3307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":889,"ondisk_log_size":889,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229552,"kb_used_data":5232,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754745168,"statfs":{"total":773094113280,"available":772859052032,"internally_reserved":0,"allocated":5357568,"data_stored":3827034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":229625402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005604"},"pg_stats":[{"pgid":"2.1f","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.628537+0000","last_change":"2024-09-13T17:25:02.628537+0000","last_active":"2024-09-13T17:25:02.628537+0000","last_peered":"2024-09-13T17:25:02.628537+0000","last_clean":"2024-09-13T17:25:02.628537+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:25:02.628537+0000","last_undegraded":"2024-09-13T17:25:02.628537+0000","last_fullsized":"2024-09-13T17:25:02.628537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.628245+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:24.649049+0000","scrub_duration":0.0070116220000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.704444+0000","last_change":"2024-09-13T17:25:06.704636+0000","last_active":"2024-09-13T17:25:06.704444+0000","last_peered":"2024-09-13T17:25:06.704444+0000","last_clean":"2024-09-13T17:25:06.704444+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:25:06.704444+0000","last_undegraded":"2024-09-13T17:25:06.704444+0000","last_fullsized":"2024-09-13T17:25:06.704444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.704389+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:51.558080+0000","scrub_duration":0.003418436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.358073+0000","last_change":"2024-09-13T17:20:55.192130+0000","last_active":"2024-09-13T17:25:00.358073+0000","last_peered":"2024-09-13T17:25:00.358073+0000","last_clean":"2024-09-13T17:25:00.358073+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:25:00.358073+0000","last_undegraded":"2024-09-13T17:25:00.358073+0000","last_fullsized":"2024-09-13T17:25:00.358073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.780000+0000","last_change":"2024-09-13T17:25:25.780196+0000","last_active":"2024-09-13T17:25:25.780000+0000","last_peered":"2024-09-13T17:25:25.780000+0000","last_clean":"2024-09-13T17:25:25.780000+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:25:25.780000+0000","last_undegraded":"2024-09-13T17:25:25.780000+0000","last_fullsized":"2024-09-13T17:25:25.780000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:25.779949+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:25.779949+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.779949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:29.384897+0000","scrub_duration":0.0031370510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.696402+0000","last_change":"2024-09-13T17:25:22.696483+0000","last_active":"2024-09-13T17:25:22.696402+0000","last_peered":"2024-09-13T17:25:22.696402+0000","last_clean":"2024-09-13T17:25:22.696402+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:25:22.696402+0000","last_undegraded":"2024-09-13T17:25:22.696402+0000","last_fullsized":"2024-09-13T17:25:22.696402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:22.696381+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:22.696381+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.696381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:05.788737+0000","scrub_duration":0.001792341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.219599+0000","last_change":"2024-09-13T17:25:31.219599+0000","last_active":"2024-09-13T17:25:31.219599+0000","last_peered":"2024-09-13T17:25:31.219599+0000","last_clean":"2024-09-13T17:25:31.219599+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:25:31.219599+0000","last_undegraded":"2024-09-13T17:25:31.219599+0000","last_fullsized":"2024-09-13T17:25:31.219599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:31.219211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:31.219211+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.219211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:34.824159+0000","scrub_duration":0.003885725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.409651+0000","last_change":"2024-09-13T17:25:24.409651+0000","last_active":"2024-09-13T17:25:24.409651+0000","last_peered":"2024-09-13T17:25:24.409651+0000","last_clean":"2024-09-13T17:25:24.409651+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:25:24.409651+0000","last_undegraded":"2024-09-13T17:25:24.409651+0000","last_fullsized":"2024-09-13T17:25:24.409651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:24.409395+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:24.409395+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.409395+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:26.545296+0000","scrub_duration":0.005542936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:38.068169+0000","last_change":"2024-09-13T17:25:38.068169+0000","last_active":"2024-09-13T17:25:38.068169+0000","last_peered":"2024-09-13T17:25:38.068169+0000","last_clean":"2024-09-13T17:25:38.068169+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:25:38.068169+0000","last_undegraded":"2024-09-13T17:25:38.068169+0000","last_fullsized":"2024-09-13T17:25:38.068169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:38.067923+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:38.067923+0000","last_clean_scrub_stamp":"2024-09-13T17:25:38.067923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:01.927744+0000","scrub_duration":0.0029584210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:48.232748+0000","last_change":"2024-09-13T17:25:48.232748+0000","last_active":"2024-09-13T17:25:48.232748+0000","last_peered":"2024-09-13T17:25:48.232748+0000","last_clean":"2024-09-13T17:25:48.232748+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:25:48.232748+0000","last_undegraded":"2024-09-13T17:25:48.232748+0000","last_fullsized":"2024-09-13T17:25:48.232748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:48.232442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:48.232442+0000","last_clean_scrub_stamp":"2024-09-13T17:25:48.232442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:03.779546+0000","scrub_duration":0.0037553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:08.412674+0000","last_change":"2024-09-13T17:25:08.412674+0000","last_active":"2024-09-13T17:25:08.412674+0000","last_peered":"2024-09-13T17:25:08.412674+0000","last_clean":"2024-09-13T17:25:08.412674+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:25:08.412674+0000","last_undegraded":"2024-09-13T17:25:08.412674+0000","last_fullsized":"2024-09-13T17:25:08.412674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_clean_scrub_stamp":"2024-09-13T17:25:08.412427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:29.772409+0000","scrub_duration":0.0057650419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'14","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.099049+0000","last_change":"2024-09-13T17:25:40.099049+0000","last_active":"2024-09-13T17:25:40.099049+0000","last_peered":"2024-09-13T17:25:40.099049+0000","last_clean":"2024-09-13T17:25:40.099049+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:25:40.099049+0000","last_undegraded":"2024-09-13T17:25:40.099049+0000","last_fullsized":"2024-09-13T17:25:40.099049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-13T17:25:40.098789+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-13T17:25:40.098789+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.098789+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:56.780958+0000","scrub_duration":0.0028693379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:26.246696+0000","last_change":"2024-09-13T17:25:26.246696+0000","last_active":"2024-09-13T17:25:26.246696+0000","last_peered":"2024-09-13T17:25:26.246696+0000","last_clean":"2024-09-13T17:25:26.246696+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:25:26.246696+0000","last_undegraded":"2024-09-13T17:25:26.246696+0000","last_fullsized":"2024-09-13T17:25:26.246696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:26.246350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:26.246350+0000","last_clean_scrub_stamp":"2024-09-13T17:25:26.246350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:16.980006+0000","scrub_duration":0.0034657339999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.803124+0000","last_change":"2024-09-13T17:25:25.803314+0000","last_active":"2024-09-13T17:25:25.803124+0000","last_peered":"2024-09-13T17:25:25.803124+0000","last_clean":"2024-09-13T17:25:25.803124+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:25:25.803124+0000","last_undegraded":"2024-09-13T17:25:25.803124+0000","last_fullsized":"2024-09-13T17:25:25.803124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:25.803067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:25.803067+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.803067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:27.938969+0000","scrub_duration":0.0029319709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.413865+0000","last_change":"2024-09-13T17:25:17.413865+0000","last_active":"2024-09-13T17:25:17.413865+0000","last_peered":"2024-09-13T17:25:17.413865+0000","last_clean":"2024-09-13T17:25:17.413865+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:25:17.413865+0000","last_undegraded":"2024-09-13T17:25:17.413865+0000","last_fullsized":"2024-09-13T17:25:17.413865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.413598+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:25.054898+0000","scrub_duration":0.0059348559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.181066+0000","last_change":"2024-09-13T17:25:37.181333+0000","last_active":"2024-09-13T17:25:37.181066+0000","last_peered":"2024-09-13T17:25:37.181066+0000","last_clean":"2024-09-13T17:25:37.181066+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:25:37.181066+0000","last_undegraded":"2024-09-13T17:25:37.181066+0000","last_fullsized":"2024-09-13T17:25:37.181066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:37.181014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:37.181014+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.181014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:01.040835+0000","scrub_duration":0.0037858309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.698823+0000","last_change":"2024-09-13T17:25:04.698823+0000","last_active":"2024-09-13T17:25:04.698823+0000","last_peered":"2024-09-13T17:25:04.698823+0000","last_clean":"2024-09-13T17:25:04.698823+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:25:04.698823+0000","last_undegraded":"2024-09-13T17:25:04.698823+0000","last_fullsized":"2024-09-13T17:25:04.698823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.698582+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:43.902693+0000","scrub_duration":0.0032068940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.218192+0000","last_change":"2024-09-13T17:25:14.218382+0000","last_active":"2024-09-13T17:25:14.218192+0000","last_peered":"2024-09-13T17:25:14.218192+0000","last_clean":"2024-09-13T17:25:14.218192+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:25:14.218192+0000","last_undegraded":"2024-09-13T17:25:14.218192+0000","last_fullsized":"2024-09-13T17:25:14.218192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.218137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:53.422249+0000","scrub_duration":0.002748159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:39.190587+0000","last_change":"2024-09-13T17:25:39.190821+0000","last_active":"2024-09-13T17:25:39.190587+0000","last_peered":"2024-09-13T17:25:39.190587+0000","last_clean":"2024-09-13T17:25:39.190587+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:25:39.190587+0000","last_undegraded":"2024-09-13T17:25:39.190587+0000","last_fullsized":"2024-09-13T17:25:39.190587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:39.190535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:39.190535+0000","last_clean_scrub_stamp":"2024-09-13T17:25:39.190535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:55.872705+0000","scrub_duration":0.0035244619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.782532+0000","last_change":"2024-09-13T17:25:30.782767+0000","last_active":"2024-09-13T17:25:30.782532+0000","last_peered":"2024-09-13T17:25:30.782532+0000","last_clean":"2024-09-13T17:25:30.782532+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:25:30.782532+0000","last_undegraded":"2024-09-13T17:25:30.782532+0000","last_fullsized":"2024-09-13T17:25:30.782532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:30.782478+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:30.782478+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.782478+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:37.562271+0000","scrub_duration":0.0034837280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.208492+0000","last_change":"2024-09-13T17:25:02.208492+0000","last_active":"2024-09-13T17:25:02.208492+0000","last_peered":"2024-09-13T17:25:02.208492+0000","last_clean":"2024-09-13T17:25:02.208492+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:25:02.208492+0000","last_undegraded":"2024-09-13T17:25:02.208492+0000","last_fullsized":"2024-09-13T17:25:02.208492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.208341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:23.568323+0000","scrub_duration":0.0022388500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.954729+0000","last_change":"2024-09-13T17:25:44.954983+0000","last_active":"2024-09-13T17:25:44.954729+0000","last_peered":"2024-09-13T17:25:44.954729+0000","last_clean":"2024-09-13T17:25:44.954729+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:25:44.954729+0000","last_undegraded":"2024-09-13T17:25:44.954729+0000","last_fullsized":"2024-09-13T17:25:44.954729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:44.954676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:44.954676+0000","last_clean_scrub_stamp":"2024-09-13T17:25:44.954676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:00.501779+0000","scrub_duration":0.0039574110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.203514+0000","last_change":"2024-09-13T17:25:07.203514+0000","last_active":"2024-09-13T17:25:07.203514+0000","last_peered":"2024-09-13T17:25:07.203514+0000","last_clean":"2024-09-13T17:25:07.203514+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:25:07.203514+0000","last_undegraded":"2024-09-13T17:25:07.203514+0000","last_fullsized":"2024-09-13T17:25:07.203514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.203223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:55.648120+0000","scrub_duration":0.0035296839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.406368+0000","last_change":"2024-09-13T17:25:25.406554+0000","last_active":"2024-09-13T17:25:25.406368+0000","last_peered":"2024-09-13T17:25:25.406368+0000","last_clean":"2024-09-13T17:25:25.406368+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:25:25.406368+0000","last_undegraded":"2024-09-13T17:25:25.406368+0000","last_fullsized":"2024-09-13T17:25:25.406368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:25.406316+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:25.406316+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.406316+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:47.268848+0000","scrub_duration":0.0033269950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:35.177036+0000","last_change":"2024-09-13T17:25:35.177303+0000","last_active":"2024-09-13T17:25:35.177036+0000","last_peered":"2024-09-13T17:25:35.177036+0000","last_clean":"2024-09-13T17:25:35.177036+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:25:35.177036+0000","last_undegraded":"2024-09-13T17:25:35.177036+0000","last_fullsized":"2024-09-13T17:25:35.177036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:35.176983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:35.176983+0000","last_clean_scrub_stamp":"2024-09-13T17:25:35.176983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:20.094265+0000","scrub_duration":0.0034760569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.671539+0000","last_change":"2024-09-13T17:25:15.671748+0000","last_active":"2024-09-13T17:25:15.671539+0000","last_peered":"2024-09-13T17:25:15.671539+0000","last_clean":"2024-09-13T17:25:15.671539+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:25:15.671539+0000","last_undegraded":"2024-09-13T17:25:15.671539+0000","last_fullsized":"2024-09-13T17:25:15.671539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.671487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.525179+0000","scrub_duration":0.0032178739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.817097+0000","last_change":"2024-09-13T17:25:07.817097+0000","last_active":"2024-09-13T17:25:07.817097+0000","last_peered":"2024-09-13T17:25:07.817097+0000","last_clean":"2024-09-13T17:25:07.817097+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:25:07.817097+0000","last_undegraded":"2024-09-13T17:25:07.817097+0000","last_fullsized":"2024-09-13T17:25:07.817097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.816834+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:51.570981+0000","scrub_duration":0.005827853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.220060+0000","last_change":"2024-09-13T17:25:40.220390+0000","last_active":"2024-09-13T17:25:40.220060+0000","last_peered":"2024-09-13T17:25:40.220060+0000","last_clean":"2024-09-13T17:25:40.220060+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:25:40.220060+0000","last_undegraded":"2024-09-13T17:25:40.220060+0000","last_fullsized":"2024-09-13T17:25:40.220060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:40.220009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:40.220009+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.220009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:39.076761+0000","scrub_duration":0.0036599860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.845728+0000","last_change":"2024-09-13T17:25:34.845919+0000","last_active":"2024-09-13T17:25:34.845728+0000","last_peered":"2024-09-13T17:25:34.845728+0000","last_clean":"2024-09-13T17:25:34.845728+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:25:34.845728+0000","last_undegraded":"2024-09-13T17:25:34.845728+0000","last_fullsized":"2024-09-13T17:25:34.845728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:34.845678+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:34.845678+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.845678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:33.702430+0000","scrub_duration":0.0033246199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'23","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.112478+0000","last_change":"2024-09-13T17:25:18.112726+0000","last_active":"2024-09-13T17:25:18.112478+0000","last_peered":"2024-09-13T17:25:18.112478+0000","last_clean":"2024-09-13T17:25:18.112478+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:25:18.112478+0000","last_undegraded":"2024-09-13T17:25:18.112478+0000","last_fullsized":"2024-09-13T17:25:18.112478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.112416+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:20.248318+0000","scrub_duration":0.0039924269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:58.570143+0000","last_change":"2024-09-13T17:20:55.190140+0000","last_active":"2024-09-13T17:24:58.570143+0000","last_peered":"2024-09-13T17:24:58.570143+0000","last_clean":"2024-09-13T17:24:58.570143+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:24:58.570143+0000","last_undegraded":"2024-09-13T17:24:58.570143+0000","last_fullsized":"2024-09-13T17:24:58.570143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:21.165184+0000","last_change":"2024-09-13T17:25:21.165461+0000","last_active":"2024-09-13T17:25:21.165184+0000","last_peered":"2024-09-13T17:25:21.165184+0000","last_clean":"2024-09-13T17:25:21.165184+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:25:21.165184+0000","last_undegraded":"2024-09-13T17:25:21.165184+0000","last_fullsized":"2024-09-13T17:25:21.165184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:21.165127+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:21.165127+0000","last_clean_scrub_stamp":"2024-09-13T17:25:21.165127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:59.258109+0000","scrub_duration":0.003019346,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.386132+0000","last_change":"2024-09-13T17:25:22.386379+0000","last_active":"2024-09-13T17:25:22.386132+0000","last_peered":"2024-09-13T17:25:22.386132+0000","last_clean":"2024-09-13T17:25:22.386132+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:25:22.386132+0000","last_undegraded":"2024-09-13T17:25:22.386132+0000","last_fullsized":"2024-09-13T17:25:22.386132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:22.386078+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:22.386078+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.386078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:07.239770+0000","scrub_duration":0.0037360340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.687521+0000","last_change":"2024-09-13T17:25:37.687860+0000","last_active":"2024-09-13T17:25:37.687521+0000","last_peered":"2024-09-13T17:25:37.687521+0000","last_clean":"2024-09-13T17:25:37.687521+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:25:37.687521+0000","last_undegraded":"2024-09-13T17:25:37.687521+0000","last_fullsized":"2024-09-13T17:25:37.687521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:37.687465+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:37.687465+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.687465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:36.544217+0000","scrub_duration":0.0033668270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.038288+0000","last_change":"2024-09-13T17:25:37.038483+0000","last_active":"2024-09-13T17:25:37.038288+0000","last_peered":"2024-09-13T17:25:37.038288+0000","last_clean":"2024-09-13T17:25:37.038288+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:25:37.038288+0000","last_undegraded":"2024-09-13T17:25:37.038288+0000","last_fullsized":"2024-09-13T17:25:37.038288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:37.038236+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:37.038236+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.038236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:43.818029+0000","scrub_duration":0.0033362869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:16.154785+0000","last_change":"2024-09-13T17:25:16.154988+0000","last_active":"2024-09-13T17:25:16.154785+0000","last_peered":"2024-09-13T17:25:16.154785+0000","last_clean":"2024-09-13T17:25:16.154785+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:25:16.154785+0000","last_undegraded":"2024-09-13T17:25:16.154785+0000","last_fullsized":"2024-09-13T17:25:16.154785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_clean_scrub_stamp":"2024-09-13T17:25:16.154736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:01.008428+0000","scrub_duration":0.0028624710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.002580+0000","last_change":"2024-09-13T17:25:33.002847+0000","last_active":"2024-09-13T17:25:33.002580+0000","last_peered":"2024-09-13T17:25:33.002580+0000","last_clean":"2024-09-13T17:25:33.002580+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:25:33.002580+0000","last_undegraded":"2024-09-13T17:25:33.002580+0000","last_fullsized":"2024-09-13T17:25:33.002580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.002518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.002518+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.002518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:39.782311+0000","scrub_duration":0.0035369780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.168785+0000","last_change":"2024-09-13T17:25:10.169043+0000","last_active":"2024-09-13T17:25:10.168785+0000","last_peered":"2024-09-13T17:25:10.168785+0000","last_clean":"2024-09-13T17:25:10.168785+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:25:10.168785+0000","last_undegraded":"2024-09-13T17:25:10.168785+0000","last_fullsized":"2024-09-13T17:25:10.168785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.168724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:49.372835+0000","scrub_duration":0.003603452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.184229+0000","last_change":"2024-09-13T17:25:18.184475+0000","last_active":"2024-09-13T17:25:18.184229+0000","last_peered":"2024-09-13T17:25:18.184229+0000","last_clean":"2024-09-13T17:25:18.184229+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:25:18.184229+0000","last_undegraded":"2024-09-13T17:25:18.184229+0000","last_fullsized":"2024-09-13T17:25:18.184229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.184172+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:57.388284+0000","scrub_duration":0.0032424060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.005026+0000","last_change":"2024-09-13T17:25:36.005321+0000","last_active":"2024-09-13T17:25:36.005026+0000","last_peered":"2024-09-13T17:25:36.005026+0000","last_clean":"2024-09-13T17:25:36.005026+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:25:36.005026+0000","last_undegraded":"2024-09-13T17:25:36.005026+0000","last_fullsized":"2024-09-13T17:25:36.005026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-13T17:25:36.004968+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-13T17:25:36.004968+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.004968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:52.687137+0000","scrub_duration":0.003791296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.184865+0000","last_change":"2024-09-13T17:25:23.185129+0000","last_active":"2024-09-13T17:25:23.184865+0000","last_peered":"2024-09-13T17:25:23.184865+0000","last_clean":"2024-09-13T17:25:23.184865+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:25:23.184865+0000","last_undegraded":"2024-09-13T17:25:23.184865+0000","last_fullsized":"2024-09-13T17:25:23.184865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:23.184812+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:23.184812+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.184812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:06.277168+0000","scrub_duration":0.003350563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'21","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.476799+0000","last_change":"2024-09-13T17:25:07.476991+0000","last_active":"2024-09-13T17:25:07.476799+0000","last_peered":"2024-09-13T17:25:07.476799+0000","last_clean":"2024-09-13T17:25:07.476799+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:25:07.476799+0000","last_undegraded":"2024-09-13T17:25:07.476799+0000","last_fullsized":"2024-09-13T17:25:07.476799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.476745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.046686+0000","scrub_duration":0.0038459200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":15,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.974688+0000","last_change":"2024-09-13T17:25:33.974929+0000","last_active":"2024-09-13T17:25:33.974688+0000","last_peered":"2024-09-13T17:25:33.974688+0000","last_clean":"2024-09-13T17:25:33.974688+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:25:33.974688+0000","last_undegraded":"2024-09-13T17:25:33.974688+0000","last_fullsized":"2024-09-13T17:25:33.974688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.974638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.974638+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.974638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:57.834459+0000","scrub_duration":0.003720063,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.646784+0000","last_change":"2024-09-13T17:25:10.647013+0000","last_active":"2024-09-13T17:25:10.646784+0000","last_peered":"2024-09-13T17:25:10.646784+0000","last_clean":"2024-09-13T17:25:10.646784+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:25:10.646784+0000","last_undegraded":"2024-09-13T17:25:10.646784+0000","last_fullsized":"2024-09-13T17:25:10.646784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.646729+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.288029+0000","scrub_duration":0.0033289930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.383868+0000","last_change":"2024-09-13T17:25:20.384055+0000","last_active":"2024-09-13T17:25:20.383868+0000","last_peered":"2024-09-13T17:25:20.383868+0000","last_clean":"2024-09-13T17:25:20.383868+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:25:20.383868+0000","last_undegraded":"2024-09-13T17:25:20.383868+0000","last_fullsized":"2024-09-13T17:25:20.383868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:20.383810+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:20.383810+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.383810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:59.587921+0000","scrub_duration":0.0033592600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:32.744816+0000","last_change":"2024-09-13T17:25:32.745091+0000","last_active":"2024-09-13T17:25:32.744816+0000","last_peered":"2024-09-13T17:25:32.744816+0000","last_clean":"2024-09-13T17:25:32.744816+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:25:32.744816+0000","last_undegraded":"2024-09-13T17:25:32.744816+0000","last_fullsized":"2024-09-13T17:25:32.744816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:32.744765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:32.744765+0000","last_clean_scrub_stamp":"2024-09-13T17:25:32.744765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:17.662047+0000","scrub_duration":0.0034942660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.672723+0000","last_change":"2024-09-13T17:25:19.672911+0000","last_active":"2024-09-13T17:25:19.672723+0000","last_peered":"2024-09-13T17:25:19.672723+0000","last_clean":"2024-09-13T17:25:19.672723+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:25:19.672723+0000","last_undegraded":"2024-09-13T17:25:19.672723+0000","last_fullsized":"2024-09-13T17:25:19.672723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:19.672673+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:19.672673+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.672673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:02.765029+0000","scrub_duration":0.0034643209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.168094+0000","last_change":"2024-09-13T17:25:19.168291+0000","last_active":"2024-09-13T17:25:19.168094+0000","last_peered":"2024-09-13T17:25:19.168094+0000","last_clean":"2024-09-13T17:25:19.168094+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:25:19.168094+0000","last_undegraded":"2024-09-13T17:25:19.168094+0000","last_fullsized":"2024-09-13T17:25:19.168094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:19.168041+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:19.168041+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.168041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:04.021733+0000","scrub_duration":0.0032097279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.464996+0000","last_change":"2024-09-13T17:25:06.465209+0000","last_active":"2024-09-13T17:25:06.464996+0000","last_peered":"2024-09-13T17:25:06.464996+0000","last_clean":"2024-09-13T17:25:06.464996+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:25:06.464996+0000","last_undegraded":"2024-09-13T17:25:06.464996+0000","last_fullsized":"2024-09-13T17:25:06.464996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.464943+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:50.219090+0000","scrub_duration":0.0095512329999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:42.695222+0000","last_change":"2024-09-13T17:25:42.695495+0000","last_active":"2024-09-13T17:25:42.695222+0000","last_peered":"2024-09-13T17:25:42.695222+0000","last_clean":"2024-09-13T17:25:42.695222+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:25:42.695222+0000","last_undegraded":"2024-09-13T17:25:42.695222+0000","last_fullsized":"2024-09-13T17:25:42.695222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.695164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.695164+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.695164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:06.554986+0000","scrub_duration":0.003511826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.395641+0000","last_change":"2024-09-13T17:25:29.395850+0000","last_active":"2024-09-13T17:25:29.395641+0000","last_peered":"2024-09-13T17:25:29.395641+0000","last_clean":"2024-09-13T17:25:29.395641+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:25:29.395641+0000","last_undegraded":"2024-09-13T17:25:29.395641+0000","last_fullsized":"2024-09-13T17:25:29.395641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:29.395585+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:29.395585+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.395585+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:12.487941+0000","scrub_duration":0.0033521530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:05.439515+0000","last_change":"2024-09-13T17:25:05.439515+0000","last_active":"2024-09-13T17:25:05.439515+0000","last_peered":"2024-09-13T17:25:05.439515+0000","last_clean":"2024-09-13T17:25:05.439515+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:25:05.439515+0000","last_undegraded":"2024-09-13T17:25:05.439515+0000","last_fullsized":"2024-09-13T17:25:05.439515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_clean_scrub_stamp":"2024-09-13T17:25:05.439251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:16.510107+0000","scrub_duration":0.003462868,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:41.719414+0000","last_change":"2024-09-13T17:25:41.719675+0000","last_active":"2024-09-13T17:25:41.719414+0000","last_peered":"2024-09-13T17:25:41.719414+0000","last_clean":"2024-09-13T17:25:41.719414+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:25:41.719414+0000","last_undegraded":"2024-09-13T17:25:41.719414+0000","last_fullsized":"2024-09-13T17:25:41.719414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.719357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.719357+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.719357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:48.499150+0000","scrub_duration":0.003464127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.122007+0000","last_change":"2024-09-13T17:25:04.122007+0000","last_active":"2024-09-13T17:25:04.122007+0000","last_peered":"2024-09-13T17:25:04.122007+0000","last_clean":"2024-09-13T17:25:04.122007+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:25:04.122007+0000","last_undegraded":"2024-09-13T17:25:04.122007+0000","last_fullsized":"2024-09-13T17:25:04.122007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.121755+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:47.875902+0000","scrub_duration":0.003354901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.195677+0000","last_change":"2024-09-13T17:25:11.195677+0000","last_active":"2024-09-13T17:25:11.195677+0000","last_peered":"2024-09-13T17:25:11.195677+0000","last_clean":"2024-09-13T17:25:11.195677+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:25:11.195677+0000","last_undegraded":"2024-09-13T17:25:11.195677+0000","last_fullsized":"2024-09-13T17:25:11.195677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.195358+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.836657+0000","scrub_duration":0.0067781489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.720498+0000","last_change":"2024-09-13T17:25:33.720746+0000","last_active":"2024-09-13T17:25:33.720498+0000","last_peered":"2024-09-13T17:25:33.720498+0000","last_clean":"2024-09-13T17:25:33.720498+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:25:33.720498+0000","last_undegraded":"2024-09-13T17:25:33.720498+0000","last_fullsized":"2024-09-13T17:25:33.720498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.720440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.720440+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.720440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:40.500232+0000","scrub_duration":0.0033947959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:39.430377+0000","last_change":"2024-09-13T17:25:39.430615+0000","last_active":"2024-09-13T17:25:39.430377+0000","last_peered":"2024-09-13T17:25:39.430377+0000","last_clean":"2024-09-13T17:25:39.430377+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:25:39.430377+0000","last_undegraded":"2024-09-13T17:25:39.430377+0000","last_fullsized":"2024-09-13T17:25:39.430377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:39.430316+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:39.430316+0000","last_clean_scrub_stamp":"2024-09-13T17:25:39.430316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:24.347598+0000","scrub_duration":0.003284524,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.438201+0000","last_change":"2024-09-13T17:25:02.438201+0000","last_active":"2024-09-13T17:25:02.438201+0000","last_peered":"2024-09-13T17:25:02.438201+0000","last_clean":"2024-09-13T17:25:02.438201+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:25:02.438201+0000","last_undegraded":"2024-09-13T17:25:02.438201+0000","last_fullsized":"2024-09-13T17:25:02.438201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.438040+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:16.318970+0000","scrub_duration":0.004819215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:49.065557+0000","last_change":"2024-09-13T17:25:49.065786+0000","last_active":"2024-09-13T17:25:49.065557+0000","last_peered":"2024-09-13T17:25:49.065557+0000","last_clean":"2024-09-13T17:25:49.065557+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:25:49.065557+0000","last_undegraded":"2024-09-13T17:25:49.065557+0000","last_fullsized":"2024-09-13T17:25:49.065557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:49.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:49.065505+0000","last_clean_scrub_stamp":"2024-09-13T17:25:49.065505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:04.612609+0000","scrub_duration":0.003721738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.495954+0000","last_change":"2024-09-13T17:25:20.496156+0000","last_active":"2024-09-13T17:25:20.495954+0000","last_peered":"2024-09-13T17:25:20.495954+0000","last_clean":"2024-09-13T17:25:20.495954+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:25:20.495954+0000","last_undegraded":"2024-09-13T17:25:20.495954+0000","last_fullsized":"2024-09-13T17:25:20.495954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.495897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:03.053370+0000","scrub_duration":0.0035695599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.150804+0000","last_change":"2024-09-13T17:25:03.150804+0000","last_active":"2024-09-13T17:25:03.150804+0000","last_peered":"2024-09-13T17:25:03.150804+0000","last_clean":"2024-09-13T17:25:03.150804+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:25:03.150804+0000","last_undegraded":"2024-09-13T17:25:03.150804+0000","last_fullsized":"2024-09-13T17:25:03.150804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.150471+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:57.941093+0000","scrub_duration":0.0066500159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:51.147537+0000","last_change":"2024-09-13T17:25:51.147834+0000","last_active":"2024-09-13T17:25:51.147537+0000","last_peered":"2024-09-13T17:25:51.147537+0000","last_clean":"2024-09-13T17:25:51.147537+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:25:51.147537+0000","last_undegraded":"2024-09-13T17:25:51.147537+0000","last_fullsized":"2024-09-13T17:25:51.147537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:51.147487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:51.147487+0000","last_clean_scrub_stamp":"2024-09-13T17:25:51.147487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:12.367687+0000","scrub_duration":0.0035323630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.356458+0000","last_change":"2024-09-13T17:25:30.356458+0000","last_active":"2024-09-13T17:25:30.356458+0000","last_peered":"2024-09-13T17:25:30.356458+0000","last_clean":"2024-09-13T17:25:30.356458+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:25:30.356458+0000","last_undegraded":"2024-09-13T17:25:30.356458+0000","last_fullsized":"2024-09-13T17:25:30.356458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:30.356190+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:30.356190+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.356190+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:21.089847+0000","scrub_duration":0.002950341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.415704+0000","last_change":"2024-09-13T17:25:04.415704+0000","last_active":"2024-09-13T17:25:04.415704+0000","last_peered":"2024-09-13T17:25:04.415704+0000","last_clean":"2024-09-13T17:25:04.415704+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:25:04.415704+0000","last_undegraded":"2024-09-13T17:25:04.415704+0000","last_fullsized":"2024-09-13T17:25:04.415704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.415439+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:54.834687+0000","scrub_duration":0.0090550500000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.678670+0000","last_change":"2024-09-13T17:25:34.678670+0000","last_active":"2024-09-13T17:25:34.678670+0000","last_peered":"2024-09-13T17:25:34.678670+0000","last_clean":"2024-09-13T17:25:34.678670+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:25:34.678670+0000","last_undegraded":"2024-09-13T17:25:34.678670+0000","last_fullsized":"2024-09-13T17:25:34.678670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:34.678370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:34.678370+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.678370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:58.538192+0000","scrub_duration":0.003490557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.726333+0000","last_change":"2024-09-13T17:25:23.726333+0000","last_active":"2024-09-13T17:25:23.726333+0000","last_peered":"2024-09-13T17:25:23.726333+0000","last_clean":"2024-09-13T17:25:23.726333+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:25:23.726333+0000","last_undegraded":"2024-09-13T17:25:23.726333+0000","last_fullsized":"2024-09-13T17:25:23.726333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:23.726069+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:23.726069+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.726069+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.579760+0000","scrub_duration":0.0033541109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.731965+0000","last_change":"2024-09-13T17:25:18.731965+0000","last_active":"2024-09-13T17:25:18.731965+0000","last_peered":"2024-09-13T17:25:18.731965+0000","last_clean":"2024-09-13T17:25:18.731965+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:25:18.731965+0000","last_undegraded":"2024-09-13T17:25:18.731965+0000","last_fullsized":"2024-09-13T17:25:18.731965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:18.731534+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:18.731534+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.731534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:26.372834+0000","scrub_duration":0.0032596539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.358042+0000","last_change":"2024-09-13T17:20:55.186146+0000","last_active":"2024-09-13T17:25:00.358042+0000","last_peered":"2024-09-13T17:25:00.358042+0000","last_clean":"2024-09-13T17:25:00.358042+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:25:00.358042+0000","last_undegraded":"2024-09-13T17:25:00.358042+0000","last_fullsized":"2024-09-13T17:25:00.358042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:27.395941+0000","last_change":"2024-09-13T17:25:27.395941+0000","last_active":"2024-09-13T17:25:27.395941+0000","last_peered":"2024-09-13T17:25:27.395941+0000","last_clean":"2024-09-13T17:25:27.395941+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:25:27.395941+0000","last_undegraded":"2024-09-13T17:25:27.395941+0000","last_fullsized":"2024-09-13T17:25:27.395941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-13T17:25:27.395675+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-13T17:25:27.395675+0000","last_clean_scrub_stamp":"2024-09-13T17:25:27.395675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:05.488656+0000","scrub_duration":0.0030620170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.118063+0000","last_change":"2024-09-13T17:25:24.118063+0000","last_active":"2024-09-13T17:25:24.118063+0000","last_peered":"2024-09-13T17:25:24.118063+0000","last_clean":"2024-09-13T17:25:24.118063+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:25:24.118063+0000","last_undegraded":"2024-09-13T17:25:24.118063+0000","last_fullsized":"2024-09-13T17:25:24.118063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:24.117812+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:24.117812+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.117812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:07.420171+0000","scrub_duration":0.003376834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.357921+0000","last_change":"2024-09-13T17:20:55.185940+0000","last_active":"2024-09-13T17:25:00.357921+0000","last_peered":"2024-09-13T17:25:00.357921+0000","last_clean":"2024-09-13T17:25:00.357921+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:25:00.357921+0000","last_undegraded":"2024-09-13T17:25:00.357921+0000","last_fullsized":"2024-09-13T17:25:00.357921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.669681+0000","last_change":"2024-09-13T17:25:13.669681+0000","last_active":"2024-09-13T17:25:13.669681+0000","last_peered":"2024-09-13T17:25:13.669681+0000","last_clean":"2024-09-13T17:25:13.669681+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:25:13.669681+0000","last_undegraded":"2024-09-13T17:25:13.669681+0000","last_fullsized":"2024-09-13T17:25:13.669681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.669441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:52.873552+0000","scrub_duration":0.0032794059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.611938+0000","last_change":"2024-09-13T17:24:59.611938+0000","last_active":"2024-09-13T17:24:59.611938+0000","last_peered":"2024-09-13T17:24:59.611938+0000","last_clean":"2024-09-13T17:24:59.611938+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:24:59.611938+0000","last_undegraded":"2024-09-13T17:24:59.611938+0000","last_fullsized":"2024-09-13T17:24:59.611938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_clean_scrub_stamp":"2024-09-13T17:24:59.611848+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:43.365995+0000","scrub_duration":0.0050935939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:50.993902+0000","last_change":"2024-09-13T17:25:50.994217+0000","last_active":"2024-09-13T17:25:50.993902+0000","last_peered":"2024-09-13T17:25:50.993902+0000","last_clean":"2024-09-13T17:25:50.993902+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:25:50.993902+0000","last_undegraded":"2024-09-13T17:25:50.993902+0000","last_fullsized":"2024-09-13T17:25:50.993902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:50.993851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:50.993851+0000","last_clean_scrub_stamp":"2024-09-13T17:25:50.993851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:12.214050+0000","scrub_duration":0.003473664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:43.477761+0000","last_change":"2024-09-13T17:25:43.477761+0000","last_active":"2024-09-13T17:25:43.477761+0000","last_peered":"2024-09-13T17:25:43.477761+0000","last_clean":"2024-09-13T17:25:43.477761+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:25:43.477761+0000","last_undegraded":"2024-09-13T17:25:43.477761+0000","last_fullsized":"2024-09-13T17:25:43.477761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:43.477448+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:43.477448+0000","last_clean_scrub_stamp":"2024-09-13T17:25:43.477448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:00.159617+0000","scrub_duration":0.0036152720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'65","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.813678+0000","last_change":"2024-09-13T17:25:09.813678+0000","last_active":"2024-09-13T17:25:09.813678+0000","last_peered":"2024-09-13T17:25:09.813678+0000","last_clean":"2024-09-13T17:25:09.813678+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:25:09.813678+0000","last_undegraded":"2024-09-13T17:25:09.813678+0000","last_fullsized":"2024-09-13T17:25:09.813678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.813409+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:31.173392+0000","scrub_duration":0.0101034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.965596+0000","last_change":"2024-09-13T17:25:36.965596+0000","last_active":"2024-09-13T17:25:36.965596+0000","last_peered":"2024-09-13T17:25:36.965596+0000","last_clean":"2024-09-13T17:25:36.965596+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:25:36.965596+0000","last_undegraded":"2024-09-13T17:25:36.965596+0000","last_fullsized":"2024-09-13T17:25:36.965596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.965286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.965286+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.965286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:35.822038+0000","scrub_duration":0.0033480490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.217074+0000","last_change":"2024-09-13T17:25:19.217074+0000","last_active":"2024-09-13T17:25:19.217074+0000","last_peered":"2024-09-13T17:25:19.217074+0000","last_clean":"2024-09-13T17:25:19.217074+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:25:19.217074+0000","last_undegraded":"2024-09-13T17:25:19.217074+0000","last_fullsized":"2024-09-13T17:25:19.217074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-13T17:25:19.216760+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-13T17:25:19.216760+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.216760+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:41.079291+0000","scrub_duration":0.002948595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.149356+0000","last_change":"2024-09-13T17:25:19.149356+0000","last_active":"2024-09-13T17:25:19.149356+0000","last_peered":"2024-09-13T17:25:19.149356+0000","last_clean":"2024-09-13T17:25:19.149356+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:25:19.149356+0000","last_undegraded":"2024-09-13T17:25:19.149356+0000","last_fullsized":"2024-09-13T17:25:19.149356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:19.148940+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:19.148940+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.148940+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:41.011472+0000","scrub_duration":0.007088352,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.191338+0000","last_change":"2024-09-13T17:25:36.191338+0000","last_active":"2024-09-13T17:25:36.191338+0000","last_peered":"2024-09-13T17:25:36.191338+0000","last_clean":"2024-09-13T17:25:36.191338+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:25:36.191338+0000","last_undegraded":"2024-09-13T17:25:36.191338+0000","last_fullsized":"2024-09-13T17:25:36.191338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.191036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.191036+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.191036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.970828+0000","scrub_duration":0.0035775889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.527098+0000","last_change":"2024-09-13T17:25:19.527297+0000","last_active":"2024-09-13T17:25:19.527098+0000","last_peered":"2024-09-13T17:25:19.527098+0000","last_clean":"2024-09-13T17:25:19.527098+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:25:19.527098+0000","last_undegraded":"2024-09-13T17:25:19.527098+0000","last_fullsized":"2024-09-13T17:25:19.527098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.527040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:23.337212+0000","scrub_duration":0.0035432609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.127641+0000","last_change":"2024-09-13T17:25:22.127641+0000","last_active":"2024-09-13T17:25:22.127641+0000","last_peered":"2024-09-13T17:25:22.127641+0000","last_clean":"2024-09-13T17:25:22.127641+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:25:22.127641+0000","last_undegraded":"2024-09-13T17:25:22.127641+0000","last_fullsized":"2024-09-13T17:25:22.127641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:22.127400+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:22.127400+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.127400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:24.263302+0000","scrub_duration":0.0030192029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:52.861250+0000","last_change":"2024-09-13T17:25:52.861482+0000","last_active":"2024-09-13T17:25:52.861250+0000","last_peered":"2024-09-13T17:25:52.861250+0000","last_clean":"2024-09-13T17:25:52.861250+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:25:52.861250+0000","last_undegraded":"2024-09-13T17:25:52.861250+0000","last_fullsized":"2024-09-13T17:25:52.861250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:52.861197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:52.861197+0000","last_clean_scrub_stamp":"2024-09-13T17:25:52.861197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:23.741287+0000","scrub_duration":0.0036737800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.088281+0000","last_change":"2024-09-13T17:25:07.088281+0000","last_active":"2024-09-13T17:25:07.088281+0000","last_peered":"2024-09-13T17:25:07.088281+0000","last_clean":"2024-09-13T17:25:07.088281+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:25:07.088281+0000","last_undegraded":"2024-09-13T17:25:07.088281+0000","last_fullsized":"2024-09-13T17:25:07.088281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.088022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:29.108827+0000","scrub_duration":0.0031517120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:21.770806+0000","last_change":"2024-09-13T17:25:21.770806+0000","last_active":"2024-09-13T17:25:21.770806+0000","last_peered":"2024-09-13T17:25:21.770806+0000","last_clean":"2024-09-13T17:25:21.770806+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:25:21.770806+0000","last_undegraded":"2024-09-13T17:25:21.770806+0000","last_fullsized":"2024-09-13T17:25:21.770806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:21.770544+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:21.770544+0000","last_clean_scrub_stamp":"2024-09-13T17:25:21.770544+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:00.974655+0000","scrub_duration":0.0030705950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:54.925129+0000","last_change":"2024-09-13T17:25:54.925393+0000","last_active":"2024-09-13T17:25:54.925129+0000","last_peered":"2024-09-13T17:25:54.925129+0000","last_clean":"2024-09-13T17:25:54.925129+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:25:54.925129+0000","last_undegraded":"2024-09-13T17:25:54.925129+0000","last_fullsized":"2024-09-13T17:25:54.925129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:54.925075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:54.925075+0000","last_clean_scrub_stamp":"2024-09-13T17:25:54.925075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:04.961219+0000","scrub_duration":0.0036078780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.733330+0000","last_change":"2024-09-13T17:25:36.733570+0000","last_active":"2024-09-13T17:25:36.733330+0000","last_peered":"2024-09-13T17:25:36.733330+0000","last_clean":"2024-09-13T17:25:36.733330+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:25:36.733330+0000","last_undegraded":"2024-09-13T17:25:36.733330+0000","last_fullsized":"2024-09-13T17:25:36.733330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.733273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.733273+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.733273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:53.415442+0000","scrub_duration":0.0032446570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.248691+0000","last_change":"2024-09-13T17:25:00.248691+0000","last_active":"2024-09-13T17:25:00.248691+0000","last_peered":"2024-09-13T17:25:00.248691+0000","last_clean":"2024-09-13T17:25:00.248691+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:25:00.248691+0000","last_undegraded":"2024-09-13T17:25:00.248691+0000","last_fullsized":"2024-09-13T17:25:00.248691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_clean_scrub_stamp":"2024-09-13T17:25:00.248535+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:44.002682+0000","scrub_duration":0.001465844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.193190+0000","last_change":"2024-09-13T17:25:15.193190+0000","last_active":"2024-09-13T17:25:15.193190+0000","last_peered":"2024-09-13T17:25:15.193190+0000","last_clean":"2024-09-13T17:25:15.193190+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:25:15.193190+0000","last_undegraded":"2024-09-13T17:25:15.193190+0000","last_fullsized":"2024-09-13T17:25:15.193190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.192937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:03.637834+0000","scrub_duration":0.0029227929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.669977+0000","last_change":"2024-09-13T17:25:40.670210+0000","last_active":"2024-09-13T17:25:40.669977+0000","last_peered":"2024-09-13T17:25:40.669977+0000","last_clean":"2024-09-13T17:25:40.669977+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:25:40.669977+0000","last_undegraded":"2024-09-13T17:25:40.669977+0000","last_fullsized":"2024-09-13T17:25:40.669977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:40.669925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:40.669925+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.669925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:25.587206+0000","scrub_duration":0.0035435430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.789082+0000","last_change":"2024-09-13T17:25:31.789082+0000","last_active":"2024-09-13T17:25:31.789082+0000","last_peered":"2024-09-13T17:25:31.789082+0000","last_clean":"2024-09-13T17:25:31.789082+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:25:31.789082+0000","last_undegraded":"2024-09-13T17:25:31.789082+0000","last_fullsized":"2024-09-13T17:25:31.789082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:31.788805+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:31.788805+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.788805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:55.648627+0000","scrub_duration":0.0031514809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.776951+0000","last_change":"2024-09-13T17:25:29.776951+0000","last_active":"2024-09-13T17:25:29.776951+0000","last_peered":"2024-09-13T17:25:29.776951+0000","last_clean":"2024-09-13T17:25:29.776951+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:25:29.776951+0000","last_undegraded":"2024-09-13T17:25:29.776951+0000","last_fullsized":"2024-09-13T17:25:29.776951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-13T17:25:29.776603+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-13T17:25:29.776603+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.776603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:14.693884+0000","scrub_duration":0.003380437,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.809132+0000","last_change":"2024-09-13T17:25:04.809132+0000","last_active":"2024-09-13T17:25:04.809132+0000","last_peered":"2024-09-13T17:25:04.809132+0000","last_clean":"2024-09-13T17:25:04.809132+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:25:04.809132+0000","last_undegraded":"2024-09-13T17:25:04.809132+0000","last_fullsized":"2024-09-13T17:25:04.809132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.808880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:50.181093+0000","scrub_duration":0.0030294929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.724560+0000","last_change":"2024-09-13T17:25:17.724560+0000","last_active":"2024-09-13T17:25:17.724560+0000","last_peered":"2024-09-13T17:25:17.724560+0000","last_clean":"2024-09-13T17:25:17.724560+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:25:17.724560+0000","last_undegraded":"2024-09-13T17:25:17.724560+0000","last_fullsized":"2024-09-13T17:25:17.724560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.724289+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:19.860190+0000","scrub_duration":0.003109784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.443046+0000","last_change":"2024-09-13T17:25:14.443046+0000","last_active":"2024-09-13T17:25:14.443046+0000","last_peered":"2024-09-13T17:25:14.443046+0000","last_clean":"2024-09-13T17:25:14.443046+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:25:14.443046+0000","last_undegraded":"2024-09-13T17:25:14.443046+0000","last_fullsized":"2024-09-13T17:25:14.443046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.442749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:47.260752+0000","scrub_duration":0.003699786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.716975+0000","last_change":"2024-09-13T17:25:20.716975+0000","last_active":"2024-09-13T17:25:20.716975+0000","last_peered":"2024-09-13T17:25:20.716975+0000","last_clean":"2024-09-13T17:25:20.716975+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:25:20.716975+0000","last_undegraded":"2024-09-13T17:25:20.716975+0000","last_fullsized":"2024-09-13T17:25:20.716975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:20.716727+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:20.716727+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.716727+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:11.450383+0000","scrub_duration":0.0034162609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:12.189375+0000","last_change":"2024-09-13T17:25:12.189375+0000","last_active":"2024-09-13T17:25:12.189375+0000","last_peered":"2024-09-13T17:25:12.189375+0000","last_clean":"2024-09-13T17:25:12.189375+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:25:12.189375+0000","last_undegraded":"2024-09-13T17:25:12.189375+0000","last_fullsized":"2024-09-13T17:25:12.189375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_clean_scrub_stamp":"2024-09-13T17:25:12.189124+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:57.042815+0000","scrub_duration":0.003516005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.358137+0000","last_change":"2024-09-13T17:21:32.724190+0000","last_active":"2024-09-13T17:25:00.358137+0000","last_peered":"2024-09-13T17:25:00.358137+0000","last_clean":"2024-09-13T17:25:00.358137+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:25:00.358137+0000","last_undegraded":"2024-09-13T17:25:00.358137+0000","last_fullsized":"2024-09-13T17:25:00.358137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:20:53.942622+0000","last_clean_scrub_stamp":"2024-09-13T17:20:53.942622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:26.762678+0000","last_change":"2024-09-13T17:25:26.762878+0000","last_active":"2024-09-13T17:25:26.762678+0000","last_peered":"2024-09-13T17:25:26.762678+0000","last_clean":"2024-09-13T17:25:26.762678+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:25:26.762678+0000","last_undegraded":"2024-09-13T17:25:26.762678+0000","last_fullsized":"2024-09-13T17:25:26.762678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:26.762621+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:26.762621+0000","last_clean_scrub_stamp":"2024-09-13T17:25:26.762621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:48.625153+0000","scrub_duration":0.0031858580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.524174+0000","last_change":"2024-09-13T17:25:09.524398+0000","last_active":"2024-09-13T17:25:09.524174+0000","last_peered":"2024-09-13T17:25:09.524174+0000","last_clean":"2024-09-13T17:25:09.524174+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:25:09.524174+0000","last_undegraded":"2024-09-13T17:25:09.524174+0000","last_fullsized":"2024-09-13T17:25:09.524174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.524113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:20.787851+0000","scrub_duration":0.0037612919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.152064+0000","last_change":"2024-09-13T17:25:25.152262+0000","last_active":"2024-09-13T17:25:25.152064+0000","last_peered":"2024-09-13T17:25:25.152064+0000","last_clean":"2024-09-13T17:25:25.152064+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:25:25.152064+0000","last_undegraded":"2024-09-13T17:25:25.152064+0000","last_fullsized":"2024-09-13T17:25:25.152064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:25.152008+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:25.152008+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.152008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:03.244989+0000","scrub_duration":0.0034582440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.722602+0000","last_change":"2024-09-13T17:25:20.722782+0000","last_active":"2024-09-13T17:25:20.722602+0000","last_peered":"2024-09-13T17:25:20.722602+0000","last_clean":"2024-09-13T17:25:20.722602+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:25:20.722602+0000","last_undegraded":"2024-09-13T17:25:20.722602+0000","last_fullsized":"2024-09-13T17:25:20.722602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:20.722540+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:20.722540+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.722540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:58.815521+0000","scrub_duration":0.0028874370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:42.829926+0000","last_change":"2024-09-13T17:25:42.830113+0000","last_active":"2024-09-13T17:25:42.829926+0000","last_peered":"2024-09-13T17:25:42.829926+0000","last_clean":"2024-09-13T17:25:42.829926+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:25:42.829926+0000","last_undegraded":"2024-09-13T17:25:42.829926+0000","last_fullsized":"2024-09-13T17:25:42.829926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:42.829873+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:42.829873+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.829873+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:58.376976+0000","scrub_duration":0.003261987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.225553+0000","last_change":"2024-09-13T17:25:24.225815+0000","last_active":"2024-09-13T17:25:24.225553+0000","last_peered":"2024-09-13T17:25:24.225553+0000","last_clean":"2024-09-13T17:25:24.225553+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:25:24.225553+0000","last_undegraded":"2024-09-13T17:25:24.225553+0000","last_fullsized":"2024-09-13T17:25:24.225553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:24.225496+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:24.225496+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.225496+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:31.343358+0000","scrub_duration":0.0028727760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'13","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.746949+0000","last_change":"2024-09-13T17:25:31.747141+0000","last_active":"2024-09-13T17:25:31.746949+0000","last_peered":"2024-09-13T17:25:31.746949+0000","last_clean":"2024-09-13T17:25:31.746949+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:25:31.746949+0000","last_undegraded":"2024-09-13T17:25:31.746949+0000","last_fullsized":"2024-09-13T17:25:31.746949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-13T17:25:31.746896+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-13T17:25:31.746896+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.746896+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:22.480553+0000","scrub_duration":0.003164381,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.884549+0000","last_change":"2024-09-13T17:25:44.884812+0000","last_active":"2024-09-13T17:25:44.884549+0000","last_peered":"2024-09-13T17:25:44.884549+0000","last_clean":"2024-09-13T17:25:44.884549+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:25:44.884549+0000","last_undegraded":"2024-09-13T17:25:44.884549+0000","last_fullsized":"2024-09-13T17:25:44.884549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:44.884492+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:44.884492+0000","last_clean_scrub_stamp":"2024-09-13T17:25:44.884492+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:06.104691+0000","scrub_duration":0.003770963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.081177+0000","last_change":"2024-09-13T17:25:30.081421+0000","last_active":"2024-09-13T17:25:30.081177+0000","last_peered":"2024-09-13T17:25:30.081177+0000","last_clean":"2024-09-13T17:25:30.081177+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:25:30.081177+0000","last_undegraded":"2024-09-13T17:25:30.081177+0000","last_fullsized":"2024-09-13T17:25:30.081177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:30.081122+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:30.081122+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.081122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:20.814778+0000","scrub_duration":0.0035714520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.650820+0000","last_change":"2024-09-13T17:25:01.650820+0000","last_active":"2024-09-13T17:25:01.650820+0000","last_peered":"2024-09-13T17:25:01.650820+0000","last_clean":"2024-09-13T17:25:01.650820+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:25:01.650820+0000","last_undegraded":"2024-09-13T17:25:01.650820+0000","last_fullsized":"2024-09-13T17:25:01.650820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_clean_scrub_stamp":"2024-09-13T17:25:01.650556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:50.095453+0000","scrub_duration":0.0034189989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'13","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.033260+0000","last_change":"2024-09-13T17:25:31.033560+0000","last_active":"2024-09-13T17:25:31.033260+0000","last_peered":"2024-09-13T17:25:31.033260+0000","last_clean":"2024-09-13T17:25:31.033260+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:25:31.033260+0000","last_undegraded":"2024-09-13T17:25:31.033260+0000","last_fullsized":"2024-09-13T17:25:31.033260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-13T17:25:31.033156+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-13T17:25:31.033156+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.033156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:46.574034+0000","scrub_duration":0.0036197479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:28.758009+0000","last_change":"2024-09-13T17:25:28.758234+0000","last_active":"2024-09-13T17:25:28.758009+0000","last_peered":"2024-09-13T17:25:28.758009+0000","last_clean":"2024-09-13T17:25:28.758009+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:25:28.758009+0000","last_undegraded":"2024-09-13T17:25:28.758009+0000","last_fullsized":"2024-09-13T17:25:28.758009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:28.757955+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:28.757955+0000","last_clean_scrub_stamp":"2024-09-13T17:25:28.757955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:32.362904+0000","scrub_duration":0.0032899600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.771982+0000","last_change":"2024-09-13T17:25:30.772179+0000","last_active":"2024-09-13T17:25:30.771982+0000","last_peered":"2024-09-13T17:25:30.771982+0000","last_clean":"2024-09-13T17:25:30.771982+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:25:30.771982+0000","last_undegraded":"2024-09-13T17:25:30.771982+0000","last_fullsized":"2024-09-13T17:25:30.771982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:30.771929+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:30.771929+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.771929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:13.864285+0000","scrub_duration":0.003260836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.467180+0000","last_change":"2024-09-13T17:25:03.467180+0000","last_active":"2024-09-13T17:25:03.467180+0000","last_peered":"2024-09-13T17:25:03.467180+0000","last_clean":"2024-09-13T17:25:03.467180+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:25:03.467180+0000","last_undegraded":"2024-09-13T17:25:03.467180+0000","last_fullsized":"2024-09-13T17:25:03.467180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.466932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:48.839144+0000","scrub_duration":0.0033368909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'12","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.503305+0000","last_change":"2024-09-13T17:25:11.503305+0000","last_active":"2024-09-13T17:25:11.503305+0000","last_peered":"2024-09-13T17:25:11.503305+0000","last_clean":"2024-09-13T17:25:11.503305+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:25:11.503305+0000","last_undegraded":"2024-09-13T17:25:11.503305+0000","last_fullsized":"2024-09-13T17:25:11.503305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.503041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:37.249276+0000","scrub_duration":0.0030805149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.019638+0000","last_change":"2024-09-13T17:25:36.019834+0000","last_active":"2024-09-13T17:25:36.019638+0000","last_peered":"2024-09-13T17:25:36.019638+0000","last_clean":"2024-09-13T17:25:36.019638+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:25:36.019638+0000","last_undegraded":"2024-09-13T17:25:36.019638+0000","last_fullsized":"2024-09-13T17:25:36.019638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:36.019585+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:36.019585+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.019585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:20.936867+0000","scrub_duration":0.00303558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.007293+0000","last_change":"2024-09-13T17:25:34.007496+0000","last_active":"2024-09-13T17:25:34.007293+0000","last_peered":"2024-09-13T17:25:34.007293+0000","last_clean":"2024-09-13T17:25:34.007293+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:25:34.007293+0000","last_undegraded":"2024-09-13T17:25:34.007293+0000","last_fullsized":"2024-09-13T17:25:34.007293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:34.007235+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:34.007235+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.007235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:26.186363+0000","scrub_duration":0.0034277930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:32.040625+0000","last_change":"2024-09-13T17:25:32.040625+0000","last_active":"2024-09-13T17:25:32.040625+0000","last_peered":"2024-09-13T17:25:32.040625+0000","last_clean":"2024-09-13T17:25:32.040625+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:25:32.040625+0000","last_undegraded":"2024-09-13T17:25:32.040625+0000","last_fullsized":"2024-09-13T17:25:32.040625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:32.040295+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:32.040295+0000","last_clean_scrub_stamp":"2024-09-13T17:25:32.040295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:16.957576+0000","scrub_duration":0.0036150750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.739461+0000","last_change":"2024-09-13T17:25:18.739461+0000","last_active":"2024-09-13T17:25:18.739461+0000","last_peered":"2024-09-13T17:25:18.739461+0000","last_clean":"2024-09-13T17:25:18.739461+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:25:18.739461+0000","last_undegraded":"2024-09-13T17:25:18.739461+0000","last_fullsized":"2024-09-13T17:25:18.739461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:18.739141+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:18.739141+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.739141+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:40.601673+0000","scrub_duration":0.0030483250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.615929+0000","last_change":"2024-09-13T17:25:13.615929+0000","last_active":"2024-09-13T17:25:13.615929+0000","last_peered":"2024-09-13T17:25:13.615929+0000","last_clean":"2024-09-13T17:25:13.615929+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:25:13.615929+0000","last_undegraded":"2024-09-13T17:25:13.615929+0000","last_fullsized":"2024-09-13T17:25:13.615929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.615679+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:35.478210+0000","scrub_duration":0.0034373250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.269523+0000","last_change":"2024-09-13T17:25:25.269523+0000","last_active":"2024-09-13T17:25:25.269523+0000","last_peered":"2024-09-13T17:25:25.269523+0000","last_clean":"2024-09-13T17:25:25.269523+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:25:25.269523+0000","last_undegraded":"2024-09-13T17:25:25.269523+0000","last_fullsized":"2024-09-13T17:25:25.269523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:25.269269+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:25.269269+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:08.361626+0000","scrub_duration":0.0031422120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:28.746464+0000","last_change":"2024-09-13T17:25:28.746464+0000","last_active":"2024-09-13T17:25:28.746464+0000","last_peered":"2024-09-13T17:25:28.746464+0000","last_clean":"2024-09-13T17:25:28.746464+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:25:28.746464+0000","last_undegraded":"2024-09-13T17:25:28.746464+0000","last_fullsized":"2024-09-13T17:25:28.746464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:28.746208+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:28.746208+0000","last_clean_scrub_stamp":"2024-09-13T17:25:28.746208+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:06.839190+0000","scrub_duration":0.0032046969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.724481+0000","last_change":"2024-09-13T17:25:36.724481+0000","last_active":"2024-09-13T17:25:36.724481+0000","last_peered":"2024-09-13T17:25:36.724481+0000","last_clean":"2024-09-13T17:25:36.724481+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:25:36.724481+0000","last_undegraded":"2024-09-13T17:25:36.724481+0000","last_fullsized":"2024-09-13T17:25:36.724481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:36.724160+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:36.724160+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.724160+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:40.329109+0000","scrub_duration":0.0028934709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.426067+0000","last_change":"2024-09-13T17:25:40.426067+0000","last_active":"2024-09-13T17:25:40.426067+0000","last_peered":"2024-09-13T17:25:40.426067+0000","last_clean":"2024-09-13T17:25:40.426067+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:25:40.426067+0000","last_undegraded":"2024-09-13T17:25:40.426067+0000","last_fullsized":"2024-09-13T17:25:40.426067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:40.425828+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:40.425828+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.425828+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:47.205620+0000","scrub_duration":0.0029070010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.804445+0000","last_change":"2024-09-13T17:25:33.804445+0000","last_active":"2024-09-13T17:25:33.804445+0000","last_peered":"2024-09-13T17:25:33.804445+0000","last_clean":"2024-09-13T17:25:33.804445+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:25:33.804445+0000","last_undegraded":"2024-09-13T17:25:33.804445+0000","last_fullsized":"2024-09-13T17:25:33.804445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:33.804129+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:33.804129+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.804129+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:50.486298+0000","scrub_duration":0.0035316409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:35.355677+0000","last_change":"2024-09-13T17:25:35.355677+0000","last_active":"2024-09-13T17:25:35.355677+0000","last_peered":"2024-09-13T17:25:35.355677+0000","last_clean":"2024-09-13T17:25:35.355677+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:25:35.355677+0000","last_undegraded":"2024-09-13T17:25:35.355677+0000","last_fullsized":"2024-09-13T17:25:35.355677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:35.355392+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:35.355392+0000","last_clean_scrub_stamp":"2024-09-13T17:25:35.355392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:38.960341+0000","scrub_duration":0.0033666540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'5","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.500116+0000","last_change":"2024-09-13T17:25:17.500315+0000","last_active":"2024-09-13T17:25:17.500116+0000","last_peered":"2024-09-13T17:25:17.500116+0000","last_clean":"2024-09-13T17:25:17.500116+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:25:17.500116+0000","last_undegraded":"2024-09-13T17:25:17.500116+0000","last_fullsized":"2024-09-13T17:25:17.500116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.500012+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:12.784295+0000","scrub_duration":0.0029179330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.460782+0000","last_change":"2024-09-13T17:25:44.460782+0000","last_active":"2024-09-13T17:25:44.460782+0000","last_peered":"2024-09-13T17:25:44.460782+0000","last_clean":"2024-09-13T17:25:44.460782+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:25:44.460782+0000","last_undegraded":"2024-09-13T17:25:44.460782+0000","last_fullsized":"2024-09-13T17:25:44.460782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:44.460481+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:44.460481+0000","last_clean_scrub_stamp":"2024-09-13T17:25:44.460481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:43.317233+0000","scrub_duration":0.0032342450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:41.140236+0000","last_change":"2024-09-13T17:25:41.140523+0000","last_active":"2024-09-13T17:25:41.140236+0000","last_peered":"2024-09-13T17:25:41.140236+0000","last_clean":"2024-09-13T17:25:41.140236+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:25:41.140236+0000","last_undegraded":"2024-09-13T17:25:41.140236+0000","last_fullsized":"2024-09-13T17:25:41.140236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:41.140184+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:41.140184+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.140184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:39.996936+0000","scrub_duration":0.00344116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.720252+0000","last_change":"2024-09-13T17:25:23.720480+0000","last_active":"2024-09-13T17:25:23.720252+0000","last_peered":"2024-09-13T17:25:23.720252+0000","last_clean":"2024-09-13T17:25:23.720252+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:25:23.720252+0000","last_undegraded":"2024-09-13T17:25:23.720252+0000","last_fullsized":"2024-09-13T17:25:23.720252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:23.720199+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:23.720199+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.720199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:14.453855+0000","scrub_duration":0.0029025990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.108525+0000","last_change":"2024-09-13T17:25:29.108723+0000","last_active":"2024-09-13T17:25:29.108525+0000","last_peered":"2024-09-13T17:25:29.108525+0000","last_clean":"2024-09-13T17:25:29.108525+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:25:29.108525+0000","last_undegraded":"2024-09-13T17:25:29.108525+0000","last_fullsized":"2024-09-13T17:25:29.108525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:29.108470+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:29.108470+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.108470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:32.713419+0000","scrub_duration":0.0030366450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:41.443056+0000","last_change":"2024-09-13T17:25:41.443255+0000","last_active":"2024-09-13T17:25:41.443056+0000","last_peered":"2024-09-13T17:25:41.443056+0000","last_clean":"2024-09-13T17:25:41.443056+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:25:41.443056+0000","last_undegraded":"2024-09-13T17:25:41.443056+0000","last_fullsized":"2024-09-13T17:25:41.443056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-13T17:25:41.443004+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-13T17:25:41.443004+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.443004+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:05.302826+0000","scrub_duration":0.0028477950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":826633,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":153,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":1653266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.80300000000000005,"15min":0.871},"min":{"1min":0.63800000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.84399999999999997,"15min":0.90800000000000003},"min":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1120000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.042}]},{"osd":1,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.82299999999999995,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.04,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.65800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.52100000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.83899999999999997},"min":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0920000000000001,"5min":1.526,"15min":1.526},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0980000000000001,"5min":1.121,"15min":1.121},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.73399999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1559999999999999,"5min":1.23,"15min":1.23},"last":1.022}]},{"osd":4,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.88400000000000001,"15min":0.92300000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1719999999999999,"5min":1.226,"15min":1.226},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.94099999999999995,"15min":0.98699999999999999},"min":{"1min":0.68500000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1299999999999999,"5min":1.365,"15min":1.365},"last":0.98899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.93000000000000005},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.163,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.97399999999999998,"15min":0.999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1859999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0309999999999999,"15min":1.107},"min":{"1min":0.73499999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.1870000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0069999999999999,"15min":1.012},"min":{"1min":0.75600000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2170000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.79500000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1130496,"data_stored":938939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1339999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.627,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.091,"5min":1.167,"15min":1.167},"last":0.79800000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79700000000000004,"15min":0.84099999999999997},"min":{"1min":0.70499999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.026,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.123},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.85499999999999998,"15min":0.90500000000000003},"min":{"1min":0.61099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.214,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0409999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.64300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.161,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.871,"15min":0.90200000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.153,"5min":1.615,"15min":1.615},"last":1.091},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.88800000000000001,"15min":0.89800000000000002},"min":{"1min":0.70799999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.103,"5min":1.268,"15min":1.268},"last":0.90300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93100000000000005,"15min":0.97399999999999998},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.1519999999999999,"5min":2.149,"15min":2.149},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":1.0149999999999999},"min":{"1min":0.745,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3540000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.92700000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.93200000000000005,"15min":0.95999999999999996},"min":{"1min":0.60399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0680000000000001,"5min":1.367,"15min":1.367},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.03,"15min":1.0620000000000001},"min":{"1min":0.69999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.212,"5min":2.069,"15min":2.069},"last":1.0620000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.046,"15min":1.075},"min":{"1min":0.88600000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.286,"5min":1.964,"15min":1.964},"last":1.145},{"interface":"front","average":{"1min":1.04,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.753,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.258,"5min":1.619,"15min":1.619},"last":1.01}]}]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.83899999999999997,"15min":0.86099999999999999},"min":{"1min":0.501,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.224,"5min":1.232,"15min":1.232},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82499999999999996,"15min":0.86799999999999999},"min":{"1min":0.58099999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0629999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.88200000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.80700000000000005,"15min":0.85099999999999998},"min":{"1min":0.64200000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.143,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.86399999999999999,"15min":0.87},"min":{"1min":0.61699999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.226,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84799999999999998,"15min":0.85799999999999998},"min":{"1min":0.624,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.98999999999999999,"5min":1.216,"15min":1.216},"last":1.073},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1830000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1839999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91800000000000004,"15min":0.92000000000000004},"min":{"1min":0.63800000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2130000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.997},{"interface":"front","average":{"1min":0.999,"5min":0.97099999999999997,"15min":0.996},"min":{"1min":0.745,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3160000000000001,"5min":1.339,"15min":1.339},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.96499999999999997,"15min":0.94699999999999995},"min":{"1min":0.629,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1519999999999999,"5min":1.546,"15min":1.546},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0469999999999999,"15min":1.095},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3149999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93799999999999994},"min":{"1min":0.68899999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.0469999999999999,"5min":1.339,"15min":1.339},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.75800000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.113,"15min":1.1539999999999999},"min":{"1min":0.70199999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.038},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0880000000000001},"min":{"1min":0.79800000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1759999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.93999999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.90300000000000002},"min":{"1min":0.61499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.161,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.86699999999999999,"15min":0.92500000000000004},"min":{"1min":0.57799999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":0.83799999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.81899999999999995,"15min":0.90300000000000002},"min":{"1min":0.54800000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.22,"5min":1.611,"15min":1.611},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77900000000000003,"15min":0.81599999999999995},"min":{"1min":0.53300000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.079,"5min":1.165,"15min":1.165},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.82199999999999995,"15min":0.876},"min":{"1min":0.55900000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.1719999999999999,"5min":1.23,"15min":1.23},"last":1.042},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.878,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.133,"5min":1.754,"15min":1.754},"last":1.02}]},{"osd":3,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85399999999999998,"15min":0.86899999999999999},"min":{"1min":0.66200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.069,"5min":1.268,"15min":1.268},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.91500000000000004,"15min":0.98099999999999998},"min":{"1min":0.78900000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2110000000000001,"5min":1.78,"15min":1.78},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92900000000000005,"15min":0.95699999999999996},"min":{"1min":0.65700000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.212,"5min":1.694,"15min":1.694},"last":1.081},{"interface":"front","average":{"1min":0.995,"5min":1.0089999999999999,"15min":1.0760000000000001},"min":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1659999999999999,"5min":1.907,"15min":1.907},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.96899999999999997,"15min":1.0169999999999999},"min":{"1min":0.65900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2030000000000001,"5min":1.53,"15min":1.53},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.0369999999999999,"15min":1.095},"min":{"1min":0.755,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2849999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0109999999999999,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.272,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.073,"15min":1.1419999999999999},"min":{"1min":0.81899999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.2549999999999999,"5min":1.863,"15min":1.863},"last":0.71599999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1142784,"data_stored":949964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.82799999999999996,"5min":1.014,"15min":1.014},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.63600000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.80400000000000005,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.625,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.93999999999999995,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.65300000000000002},"min":{"1min":0.29399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.89500000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67600000000000005,"15min":0.70599999999999996},"min":{"1min":0.39900000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0129999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.95299999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.82799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84999999999999998,"15min":0.89000000000000001},"min":{"1min":0.64200000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1379999999999999,"5min":1.51,"15min":1.51},"last":0.75},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.89800000000000002,"15min":0.94099999999999995},"min":{"1min":0.72599999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1419999999999999,"5min":1.421,"15min":1.421},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.89900000000000002,"15min":0.93500000000000005},"min":{"1min":0.749,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.165,"5min":1.415,"15min":1.415},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.91100000000000003,"15min":0.94099999999999995},"min":{"1min":0.57599999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5069999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.097}]},{"osd":6,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.87,"15min":0.90600000000000003},"min":{"1min":0.67700000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.127,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95399999999999996,"15min":1.0049999999999999},"min":{"1min":0.72499999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.212,"5min":1.712,"15min":1.712},"last":1.1379999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.95399999999999996,"15min":1.004},"min":{"1min":0.63400000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.446,"5min":1.756,"15min":1.756},"last":1.002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.93700000000000006,"15min":1},"min":{"1min":0.79900000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1559999999999999,"5min":1.946,"15min":1.946},"last":0.93300000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56799999999999995,"15min":0.61699999999999999},"min":{"1min":0.27700000000000002,"5min":0.192,"15min":0.192},"max":{"1min":1.1120000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.61399999999999999,"15min":0.67400000000000004},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":1.1040000000000001,"5min":1.466,"15min":1.466},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60199999999999998,"15min":0.625},"min":{"1min":0.32400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98899999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.67300000000000004},"min":{"1min":0.28499999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.94999999999999996,"5min":1.419,"15min":1.419},"last":1.0129999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.67100000000000004,"15min":0.78500000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0740000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66500000000000004,"15min":0.72499999999999998},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2809999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.86499999999999999,"15min":0.89500000000000002},"min":{"1min":0.56599999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3009999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.85799999999999998,"15min":0.94399999999999995},"min":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2729999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.252}]},{"osd":5,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.91200000000000003,"15min":0.96699999999999997},"min":{"1min":0.54000000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.621,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.085},{"interface":"front","average":{"1min":1.002,"5min":0.91800000000000004,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7549999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.96099999999999997,"15min":1},"min":{"1min":0.68799999999999994,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.696,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.94999999999999996,"15min":1.0249999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.6100000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.91600000000000004,"15min":1.0129999999999999},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2070000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.466},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.002,"15min":1.0740000000000001},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.5369999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1879999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56899999999999995,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.98499999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.624},"min":{"1min":0.29199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":1,"5min":1,"15min":1},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.39500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.196,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.64600000000000002,"15min":0.67000000000000004},"min":{"1min":0.34300000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0429999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.623,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0069999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68600000000000005,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.1319999999999999,"5min":1.401,"15min":1.401},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.82899999999999996,"15min":0.875},"min":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.103,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.84799999999999998,"15min":0.88800000000000001},"min":{"1min":0.66200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.67200000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.21,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.88900000000000001,"15min":0.93899999999999995},"min":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3300000000000001,"5min":1.365,"15min":1.365},"last":1.087}]},{"osd":6,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85799999999999998,"15min":0.91500000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0960000000000001,"5min":1.323,"15min":1.323},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.002,"5min":0.94099999999999995,"15min":0.997},"min":{"1min":0.748,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2609999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.1299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92900000000000005,"15min":0.99199999999999999},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.379,"5min":1.639,"15min":1.639},"last":1.012},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92100000000000004,"15min":0.98399999999999999},"min":{"1min":0.73399999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.163,"5min":1.528,"15min":1.528},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":135154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.27800000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.60699999999999998},"min":{"1min":0.436,"5min":0.255,"15min":0.255},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.624,"15min":0.65300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.026,"5min":1.075,"15min":1.075},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.90400000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.62,"15min":0.65800000000000003},"min":{"1min":0.38300000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.67900000000000005,"15min":0.73099999999999998},"min":{"1min":0.372,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.98699999999999999,"5min":1.149,"15min":1.149},"last":1.194}]},{"osd":4,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85099999999999998,"15min":0.88300000000000001},"min":{"1min":0.63900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2390000000000001,"5min":1.351,"15min":1.351},"last":0.88},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.84599999999999997,"15min":0.876},"min":{"1min":0.59499999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.1459999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.94099999999999995},"min":{"1min":0.69999999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.88400000000000001,"15min":0.92800000000000005},"min":{"1min":0.58299999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.107}]},{"osd":6,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.89000000000000001,"15min":0.92600000000000005},"min":{"1min":0.62,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.91800000000000004,"15min":0.97699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.1359999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.91000000000000003,"15min":0.96399999999999997},"min":{"1min":0.78900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4179999999999999,"5min":1.554,"15min":1.554},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93500000000000005,"15min":0.97499999999999998},"min":{"1min":0.64800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.073}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":814810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:26:03.615 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:26:03.616 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:26:03.616 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:26:03.616 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:26:03.617 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T17:20:53.942622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=20, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:26:03.617 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:26:22.691 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:22.694 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:23.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:26:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f406a96b640 1 Processor -- start 2024-09-13T17:26:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f406a96b640 1 -- start start 2024-09-13T17:26:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f406a96b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f40640b0540 0x7f4064145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f406a96b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640b00b0 con 0x7f406413f9d0 2024-09-13T17:26:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f406a96b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640b2290 con 0x7f40640b1eb0 2024-09-13T17:26:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f406a96b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406406f600 con 0x7f40640b0540 2024-09-13T17:26:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f4068f08640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f406413f9d0 0x7f406414d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40898/0 (socket says 172.21.15.167:40898) 2024-09-13T17:26:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f4068f08640 1 -- 172.21.15.167:0/77902583 learned_addr learned my addr 172.21.15.167:0/77902583 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:26:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.745+0000 7f40637fe640 1 --2- 172.21.15.167:0/77902583 >> v2:172.21.15.190:3300/0 conn(0x7f40640b0540 0x7f4064145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.749+0000 7f40637fe640 1 -- 172.21.15.167:0/77902583 >> v1:172.21.15.190:6789/0 conn(0x7f40640b1eb0 legacy=0x7f40640b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.749+0000 7f40637fe640 1 -- 172.21.15.167:0/77902583 >> v1:172.21.15.167:6789/0 conn(0x7f406413f9d0 legacy=0x7f406414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.749+0000 7f40637fe640 1 -- 172.21.15.167:0/77902583 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640afa60 con 0x7f40640b0540 2024-09-13T17:26:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.749+0000 7f40637fe640 1 --2- 172.21.15.167:0/77902583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b0540 0x7f4064145cb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40580097c0 tx=0x7f405801e620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d74477a0459c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4062ffd640 1 -- 172.21.15.167:0/77902583 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580ad640 con 0x7f40640b0540 2024-09-13T17:26:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4062ffd640 1 -- 172.21.15.167:0/77902583 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40580a9070 con 0x7f40640b0540 2024-09-13T17:26:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4062ffd640 1 -- 172.21.15.167:0/77902583 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580ad9c0 con 0x7f40640b0540 2024-09-13T17:26:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- 172.21.15.167:0/77902583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b0540 msgr2=0x7f4064145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 --2- 172.21.15.167:0/77902583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b0540 0x7f4064145cb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40580097c0 tx=0x7f405801e620 comp rx=0 tx=0).stop 2024-09-13T17:26:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- 172.21.15.167:0/77902583 shutdown_connections 2024-09-13T17:26:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 --2- 172.21.15.167:0/77902583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b0540 0x7f4064145cb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- 172.21.15.167:0/77902583 >> 172.21.15.167:0/77902583 conn(0x7f40640b7250 msgr2=0x7f40640b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- 172.21.15.167:0/77902583 shutdown_connections 2024-09-13T17:26:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- 172.21.15.167:0/77902583 wait complete. 2024-09-13T17:26:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 Processor -- start 2024-09-13T17:26:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- start start 2024-09-13T17:26:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40640b0540 0x7f40641446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b1eb0 0x7f406413e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f406413f9d0 0x7f40641da880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4064143e60 con 0x7f40640b0540 2024-09-13T17:26:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406413eec0 con 0x7f40640b1eb0 2024-09-13T17:26:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4064144dd0 con 0x7f406413f9d0 2024-09-13T17:26:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40640b0540 0x7f40641446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40640b0540 0x7f40641446f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59532/0 (socket says 172.21.15.167:59532) 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 -- 172.21.15.167:0/3231256657 learned_addr learned my addr 172.21.15.167:0/3231256657 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4068f08640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f406413f9d0 0x7f40641da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f40637fe640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b1eb0 0x7f406413e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 -- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f406413f9d0 msgr2=0x7f40641da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f406413f9d0 0x7f40641da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 -- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b1eb0 msgr2=0x7f406413e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b1eb0 0x7f406413e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 -- 172.21.15.167:0/3231256657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009420 con 0x7f40640b0540 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4063fff640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40640b0540 0x7f40641446f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f405400c3c0 tx=0x7f405400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4060ff9640 1 -- 172.21.15.167:0/3231256657 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40540052d0 con 0x7f40640b0540 2024-09-13T17:26:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4060ff9640 1 -- 172.21.15.167:0/3231256657 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054005430 con 0x7f40640b0540 2024-09-13T17:26:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406413f160 con 0x7f40640b0540 2024-09-13T17:26:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f4060ff9640 1 -- 172.21.15.167:0/3231256657 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054003840 con 0x7f40640b0540 2024-09-13T17:26:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.753+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406413e6c0 con 0x7f40640b0540 2024-09-13T17:26:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.757+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406413e910 con 0x7f40640b0540 2024-09-13T17:26:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.757+0000 7f4060ff9640 1 -- 172.21.15.167:0/3231256657 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40540039a0 con 0x7f40640b0540 2024-09-13T17:26:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.757+0000 7f4060ff9640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4050066690 0x7f4050068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.757+0000 7f40637fe640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4050066690 0x7f4050068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.757+0000 7f4060ff9640 1 -- 172.21.15.167:0/3231256657 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f40540839f0 con 0x7f40640b0540 2024-09-13T17:26:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.757+0000 7f40637fe640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4050066690 0x7f4050068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40580b1000 tx=0x7f40580a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.761+0000 7f4060ff9640 1 -- 172.21.15.167:0/3231256657 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4054050a10 con 0x7f40640b0540 2024-09-13T17:26:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.917+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 --> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40641466f0 con 0x7f4050066690 2024-09-13T17:26:23.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.941+0000 7f4060ff9640 1 -- 172.21.15.167:0/3231256657 <== mgr.4107 v2:172.21.15.167:6832/1477469698 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371053 (secure 0 0 0) 0x7f40641466f0 con 0x7f4050066690 2024-09-13T17:26:23.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:26:23.954 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2024-09-13T17:26:23.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.945+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4050066690 msgr2=0x7f4050068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.945+0000 7f406a96b640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4050066690 0x7f4050068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40580b1000 tx=0x7f40580a9000 comp rx=0 tx=0).stop 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.945+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40640b0540 msgr2=0x7f40641446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.945+0000 7f406a96b640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40640b0540 0x7f40641446f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f405400c3c0 tx=0x7f405400c880 comp rx=0 tx=0).stop 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 shutdown_connections 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f4050066690 0x7f4050068b50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f406413f9d0 0x7f40641da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40640b1eb0 0x7f406413e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 --2- 172.21.15.167:0/3231256657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40640b0540 0x7f40641446f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 >> 172.21.15.167:0/3231256657 conn(0x7f40640b7250 msgr2=0x7f40640ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:23.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 shutdown_connections 2024-09-13T17:26:23.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:23.949+0000 7f406a96b640 1 -- 172.21.15.167:0/3231256657 wait complete. 2024-09-13T17:26:23.969 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-13T17:26:23.612343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1417001,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":122,"num_write":318,"num_write_kb":3307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":889,"ondisk_log_size":889,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229552,"kb_used_data":5232,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754745168,"statfs":{"total":773094113280,"available":772859052032,"internally_reserved":0,"allocated":5357568,"data_stored":3827034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":229625402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005372"},"pg_stats":[{"pgid":"2.1f","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.628537+0000","last_change":"2024-09-13T17:25:02.628537+0000","last_active":"2024-09-13T17:25:02.628537+0000","last_peered":"2024-09-13T17:25:02.628537+0000","last_clean":"2024-09-13T17:25:02.628537+0000","last_became_active":"2024-09-13T17:20:50.591988+0000","last_became_peered":"2024-09-13T17:20:50.591988+0000","last_unstale":"2024-09-13T17:25:02.628537+0000","last_undegraded":"2024-09-13T17:25:02.628537+0000","last_fullsized":"2024-09-13T17:25:02.628537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:02.628245+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.628245+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:24.649049+0000","scrub_duration":0.0070116220000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.704444+0000","last_change":"2024-09-13T17:25:06.704636+0000","last_active":"2024-09-13T17:25:06.704444+0000","last_peered":"2024-09-13T17:25:06.704444+0000","last_clean":"2024-09-13T17:25:06.704444+0000","last_became_active":"2024-09-13T17:20:50.974014+0000","last_became_peered":"2024-09-13T17:20:50.974014+0000","last_unstale":"2024-09-13T17:25:06.704444+0000","last_undegraded":"2024-09-13T17:25:06.704444+0000","last_fullsized":"2024-09-13T17:25:06.704444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:06.704389+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.704389+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:51.558080+0000","scrub_duration":0.003418436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:26:15.066670+0000","last_change":"2024-09-13T17:26:15.066939+0000","last_active":"2024-09-13T17:26:15.066670+0000","last_peered":"2024-09-13T17:26:15.066670+0000","last_clean":"2024-09-13T17:26:15.066670+0000","last_became_active":"2024-09-13T17:20:55.191626+0000","last_became_peered":"2024-09-13T17:20:55.191626+0000","last_unstale":"2024-09-13T17:26:15.066670+0000","last_undegraded":"2024-09-13T17:26:15.066670+0000","last_fullsized":"2024-09-13T17:26:15.066670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:26:15.066617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:26:15.066617+0000","last_clean_scrub_stamp":"2024-09-13T17:26:15.066617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:32.682460+0000","scrub_duration":0.0033860959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.780000+0000","last_change":"2024-09-13T17:25:25.780196+0000","last_active":"2024-09-13T17:25:25.780000+0000","last_peered":"2024-09-13T17:25:25.780000+0000","last_clean":"2024-09-13T17:25:25.780000+0000","last_became_active":"2024-09-13T17:20:50.584328+0000","last_became_peered":"2024-09-13T17:20:50.584328+0000","last_unstale":"2024-09-13T17:25:25.780000+0000","last_undegraded":"2024-09-13T17:25:25.780000+0000","last_fullsized":"2024-09-13T17:25:25.780000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:25.779949+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:25.779949+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.779949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:29.384897+0000","scrub_duration":0.0031370510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.696402+0000","last_change":"2024-09-13T17:25:22.696483+0000","last_active":"2024-09-13T17:25:22.696402+0000","last_peered":"2024-09-13T17:25:22.696402+0000","last_clean":"2024-09-13T17:25:22.696402+0000","last_became_active":"2024-09-13T17:20:50.970546+0000","last_became_peered":"2024-09-13T17:20:50.970546+0000","last_unstale":"2024-09-13T17:25:22.696402+0000","last_undegraded":"2024-09-13T17:25:22.696402+0000","last_fullsized":"2024-09-13T17:25:22.696402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:22.696381+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:22.696381+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.696381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:05.788737+0000","scrub_duration":0.001792341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.219599+0000","last_change":"2024-09-13T17:25:31.219599+0000","last_active":"2024-09-13T17:25:31.219599+0000","last_peered":"2024-09-13T17:25:31.219599+0000","last_clean":"2024-09-13T17:25:31.219599+0000","last_became_active":"2024-09-13T17:20:55.000182+0000","last_became_peered":"2024-09-13T17:20:55.000182+0000","last_unstale":"2024-09-13T17:25:31.219599+0000","last_undegraded":"2024-09-13T17:25:31.219599+0000","last_fullsized":"2024-09-13T17:25:31.219599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:31.219211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:31.219211+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.219211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:34.824159+0000","scrub_duration":0.003885725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.409651+0000","last_change":"2024-09-13T17:25:24.409651+0000","last_active":"2024-09-13T17:25:24.409651+0000","last_peered":"2024-09-13T17:25:24.409651+0000","last_clean":"2024-09-13T17:25:24.409651+0000","last_became_active":"2024-09-13T17:20:50.617703+0000","last_became_peered":"2024-09-13T17:20:50.617703+0000","last_unstale":"2024-09-13T17:25:24.409651+0000","last_undegraded":"2024-09-13T17:25:24.409651+0000","last_fullsized":"2024-09-13T17:25:24.409651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:24.409395+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:24.409395+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.409395+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:26.545296+0000","scrub_duration":0.005542936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:38.068169+0000","last_change":"2024-09-13T17:25:38.068169+0000","last_active":"2024-09-13T17:25:38.068169+0000","last_peered":"2024-09-13T17:25:38.068169+0000","last_clean":"2024-09-13T17:25:38.068169+0000","last_became_active":"2024-09-13T17:20:50.987445+0000","last_became_peered":"2024-09-13T17:20:50.987445+0000","last_unstale":"2024-09-13T17:25:38.068169+0000","last_undegraded":"2024-09-13T17:25:38.068169+0000","last_fullsized":"2024-09-13T17:25:38.068169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:38.067923+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:38.067923+0000","last_clean_scrub_stamp":"2024-09-13T17:25:38.067923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:01.927744+0000","scrub_duration":0.0029584210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:48.232748+0000","last_change":"2024-09-13T17:25:48.232748+0000","last_active":"2024-09-13T17:25:48.232748+0000","last_peered":"2024-09-13T17:25:48.232748+0000","last_clean":"2024-09-13T17:25:48.232748+0000","last_became_active":"2024-09-13T17:20:55.006547+0000","last_became_peered":"2024-09-13T17:20:55.006547+0000","last_unstale":"2024-09-13T17:25:48.232748+0000","last_undegraded":"2024-09-13T17:25:48.232748+0000","last_fullsized":"2024-09-13T17:25:48.232748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:48.232442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:48.232442+0000","last_clean_scrub_stamp":"2024-09-13T17:25:48.232442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:03.779546+0000","scrub_duration":0.0037553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:08.412674+0000","last_change":"2024-09-13T17:25:08.412674+0000","last_active":"2024-09-13T17:25:08.412674+0000","last_peered":"2024-09-13T17:25:08.412674+0000","last_clean":"2024-09-13T17:25:08.412674+0000","last_became_active":"2024-09-13T17:20:50.613803+0000","last_became_peered":"2024-09-13T17:20:50.613803+0000","last_unstale":"2024-09-13T17:25:08.412674+0000","last_undegraded":"2024-09-13T17:25:08.412674+0000","last_fullsized":"2024-09-13T17:25:08.412674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:08.412427+0000","last_clean_scrub_stamp":"2024-09-13T17:25:08.412427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:29.772409+0000","scrub_duration":0.0057650419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'14","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.099049+0000","last_change":"2024-09-13T17:25:40.099049+0000","last_active":"2024-09-13T17:25:40.099049+0000","last_peered":"2024-09-13T17:25:40.099049+0000","last_clean":"2024-09-13T17:25:40.099049+0000","last_became_active":"2024-09-13T17:20:50.987461+0000","last_became_peered":"2024-09-13T17:20:50.987461+0000","last_unstale":"2024-09-13T17:25:40.099049+0000","last_undegraded":"2024-09-13T17:25:40.099049+0000","last_fullsized":"2024-09-13T17:25:40.099049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-13T17:25:40.098789+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-13T17:25:40.098789+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.098789+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:56.780958+0000","scrub_duration":0.0028693379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:26.246696+0000","last_change":"2024-09-13T17:25:26.246696+0000","last_active":"2024-09-13T17:25:26.246696+0000","last_peered":"2024-09-13T17:25:26.246696+0000","last_clean":"2024-09-13T17:25:26.246696+0000","last_became_active":"2024-09-13T17:20:54.993662+0000","last_became_peered":"2024-09-13T17:20:54.993662+0000","last_unstale":"2024-09-13T17:25:26.246696+0000","last_undegraded":"2024-09-13T17:25:26.246696+0000","last_fullsized":"2024-09-13T17:25:26.246696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:26.246350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:26.246350+0000","last_clean_scrub_stamp":"2024-09-13T17:25:26.246350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:16.980006+0000","scrub_duration":0.0034657339999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.803124+0000","last_change":"2024-09-13T17:25:25.803314+0000","last_active":"2024-09-13T17:25:25.803124+0000","last_peered":"2024-09-13T17:25:25.803124+0000","last_clean":"2024-09-13T17:25:25.803124+0000","last_became_active":"2024-09-13T17:20:50.978932+0000","last_became_peered":"2024-09-13T17:20:50.978932+0000","last_unstale":"2024-09-13T17:25:25.803124+0000","last_undegraded":"2024-09-13T17:25:25.803124+0000","last_fullsized":"2024-09-13T17:25:25.803124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:25.803067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:25.803067+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.803067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:27.938969+0000","scrub_duration":0.0029319709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.413865+0000","last_change":"2024-09-13T17:25:17.413865+0000","last_active":"2024-09-13T17:25:17.413865+0000","last_peered":"2024-09-13T17:25:17.413865+0000","last_clean":"2024-09-13T17:25:17.413865+0000","last_became_active":"2024-09-13T17:20:50.607342+0000","last_became_peered":"2024-09-13T17:20:50.607342+0000","last_unstale":"2024-09-13T17:25:17.413865+0000","last_undegraded":"2024-09-13T17:25:17.413865+0000","last_fullsized":"2024-09-13T17:25:17.413865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:17.413598+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.413598+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:25.054898+0000","scrub_duration":0.0059348559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.181066+0000","last_change":"2024-09-13T17:25:37.181333+0000","last_active":"2024-09-13T17:25:37.181066+0000","last_peered":"2024-09-13T17:25:37.181066+0000","last_clean":"2024-09-13T17:25:37.181066+0000","last_became_active":"2024-09-13T17:20:54.995228+0000","last_became_peered":"2024-09-13T17:20:54.995228+0000","last_unstale":"2024-09-13T17:25:37.181066+0000","last_undegraded":"2024-09-13T17:25:37.181066+0000","last_fullsized":"2024-09-13T17:25:37.181066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:37.181014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:37.181014+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.181014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:01.040835+0000","scrub_duration":0.0037858309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.698823+0000","last_change":"2024-09-13T17:25:04.698823+0000","last_active":"2024-09-13T17:25:04.698823+0000","last_peered":"2024-09-13T17:25:04.698823+0000","last_clean":"2024-09-13T17:25:04.698823+0000","last_became_active":"2024-09-13T17:20:50.951916+0000","last_became_peered":"2024-09-13T17:20:50.951916+0000","last_unstale":"2024-09-13T17:25:04.698823+0000","last_undegraded":"2024-09-13T17:25:04.698823+0000","last_fullsized":"2024-09-13T17:25:04.698823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:04.698582+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.698582+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:43.902693+0000","scrub_duration":0.0032068940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.218192+0000","last_change":"2024-09-13T17:25:14.218382+0000","last_active":"2024-09-13T17:25:14.218192+0000","last_peered":"2024-09-13T17:25:14.218192+0000","last_clean":"2024-09-13T17:25:14.218192+0000","last_became_active":"2024-09-13T17:20:50.585404+0000","last_became_peered":"2024-09-13T17:20:50.585404+0000","last_unstale":"2024-09-13T17:25:14.218192+0000","last_undegraded":"2024-09-13T17:25:14.218192+0000","last_fullsized":"2024-09-13T17:25:14.218192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.218137+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.218137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:53.422249+0000","scrub_duration":0.002748159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:39.190587+0000","last_change":"2024-09-13T17:25:39.190821+0000","last_active":"2024-09-13T17:25:39.190587+0000","last_peered":"2024-09-13T17:25:39.190587+0000","last_clean":"2024-09-13T17:25:39.190587+0000","last_became_active":"2024-09-13T17:20:55.004219+0000","last_became_peered":"2024-09-13T17:20:55.004219+0000","last_unstale":"2024-09-13T17:25:39.190587+0000","last_undegraded":"2024-09-13T17:25:39.190587+0000","last_fullsized":"2024-09-13T17:25:39.190587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:39.190535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:39.190535+0000","last_clean_scrub_stamp":"2024-09-13T17:25:39.190535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:55.872705+0000","scrub_duration":0.0035244619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.782532+0000","last_change":"2024-09-13T17:25:30.782767+0000","last_active":"2024-09-13T17:25:30.782532+0000","last_peered":"2024-09-13T17:25:30.782532+0000","last_clean":"2024-09-13T17:25:30.782532+0000","last_became_active":"2024-09-13T17:20:50.944070+0000","last_became_peered":"2024-09-13T17:20:50.944070+0000","last_unstale":"2024-09-13T17:25:30.782532+0000","last_undegraded":"2024-09-13T17:25:30.782532+0000","last_fullsized":"2024-09-13T17:25:30.782532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:30.782478+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:30.782478+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.782478+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:37.562271+0000","scrub_duration":0.0034837280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.208492+0000","last_change":"2024-09-13T17:25:02.208492+0000","last_active":"2024-09-13T17:25:02.208492+0000","last_peered":"2024-09-13T17:25:02.208492+0000","last_clean":"2024-09-13T17:25:02.208492+0000","last_became_active":"2024-09-13T17:20:50.592223+0000","last_became_peered":"2024-09-13T17:20:50.592223+0000","last_unstale":"2024-09-13T17:25:02.208492+0000","last_undegraded":"2024-09-13T17:25:02.208492+0000","last_fullsized":"2024-09-13T17:25:02.208492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:02.208341+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.208341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:23.568323+0000","scrub_duration":0.0022388500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.954729+0000","last_change":"2024-09-13T17:25:44.954983+0000","last_active":"2024-09-13T17:25:44.954729+0000","last_peered":"2024-09-13T17:25:44.954729+0000","last_clean":"2024-09-13T17:25:44.954729+0000","last_became_active":"2024-09-13T17:20:55.188629+0000","last_became_peered":"2024-09-13T17:20:55.188629+0000","last_unstale":"2024-09-13T17:25:44.954729+0000","last_undegraded":"2024-09-13T17:25:44.954729+0000","last_fullsized":"2024-09-13T17:25:44.954729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:44.954676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:44.954676+0000","last_clean_scrub_stamp":"2024-09-13T17:25:44.954676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:00.501779+0000","scrub_duration":0.0039574110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.203514+0000","last_change":"2024-09-13T17:25:07.203514+0000","last_active":"2024-09-13T17:25:07.203514+0000","last_peered":"2024-09-13T17:25:07.203514+0000","last_clean":"2024-09-13T17:25:07.203514+0000","last_became_active":"2024-09-13T17:20:50.973467+0000","last_became_peered":"2024-09-13T17:20:50.973467+0000","last_unstale":"2024-09-13T17:25:07.203514+0000","last_undegraded":"2024-09-13T17:25:07.203514+0000","last_fullsized":"2024-09-13T17:25:07.203514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:07.203223+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.203223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:55.648120+0000","scrub_duration":0.0035296839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.406368+0000","last_change":"2024-09-13T17:25:25.406554+0000","last_active":"2024-09-13T17:25:25.406368+0000","last_peered":"2024-09-13T17:25:25.406368+0000","last_clean":"2024-09-13T17:25:25.406368+0000","last_became_active":"2024-09-13T17:20:50.607792+0000","last_became_peered":"2024-09-13T17:20:50.607792+0000","last_unstale":"2024-09-13T17:25:25.406368+0000","last_undegraded":"2024-09-13T17:25:25.406368+0000","last_fullsized":"2024-09-13T17:25:25.406368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:25.406316+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:25.406316+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.406316+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:47.268848+0000","scrub_duration":0.0033269950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:35.177036+0000","last_change":"2024-09-13T17:25:35.177303+0000","last_active":"2024-09-13T17:25:35.177036+0000","last_peered":"2024-09-13T17:25:35.177036+0000","last_clean":"2024-09-13T17:25:35.177036+0000","last_became_active":"2024-09-13T17:21:33.375820+0000","last_became_peered":"2024-09-13T17:21:33.375820+0000","last_unstale":"2024-09-13T17:25:35.177036+0000","last_undegraded":"2024-09-13T17:25:35.177036+0000","last_fullsized":"2024-09-13T17:25:35.177036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:35.176983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:35.176983+0000","last_clean_scrub_stamp":"2024-09-13T17:25:35.176983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:20.094265+0000","scrub_duration":0.0034760569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.671539+0000","last_change":"2024-09-13T17:25:15.671748+0000","last_active":"2024-09-13T17:25:15.671539+0000","last_peered":"2024-09-13T17:25:15.671539+0000","last_clean":"2024-09-13T17:25:15.671539+0000","last_became_active":"2024-09-13T17:20:50.945508+0000","last_became_peered":"2024-09-13T17:20:50.945508+0000","last_unstale":"2024-09-13T17:25:15.671539+0000","last_undegraded":"2024-09-13T17:25:15.671539+0000","last_fullsized":"2024-09-13T17:25:15.671539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.671487+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.671487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.525179+0000","scrub_duration":0.0032178739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.817097+0000","last_change":"2024-09-13T17:25:07.817097+0000","last_active":"2024-09-13T17:25:07.817097+0000","last_peered":"2024-09-13T17:25:07.817097+0000","last_clean":"2024-09-13T17:25:07.817097+0000","last_became_active":"2024-09-13T17:20:50.611182+0000","last_became_peered":"2024-09-13T17:20:50.611182+0000","last_unstale":"2024-09-13T17:25:07.817097+0000","last_undegraded":"2024-09-13T17:25:07.817097+0000","last_fullsized":"2024-09-13T17:25:07.817097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:07.816834+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.816834+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:51.570981+0000","scrub_duration":0.005827853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.220060+0000","last_change":"2024-09-13T17:25:40.220390+0000","last_active":"2024-09-13T17:25:40.220060+0000","last_peered":"2024-09-13T17:25:40.220060+0000","last_clean":"2024-09-13T17:25:40.220060+0000","last_became_active":"2024-09-13T17:20:55.194065+0000","last_became_peered":"2024-09-13T17:20:55.194065+0000","last_unstale":"2024-09-13T17:25:40.220060+0000","last_undegraded":"2024-09-13T17:25:40.220060+0000","last_fullsized":"2024-09-13T17:25:40.220060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:40.220009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:40.220009+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.220009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:39.076761+0000","scrub_duration":0.0036599860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.845728+0000","last_change":"2024-09-13T17:25:34.845919+0000","last_active":"2024-09-13T17:25:34.845728+0000","last_peered":"2024-09-13T17:25:34.845728+0000","last_clean":"2024-09-13T17:25:34.845728+0000","last_became_active":"2024-09-13T17:20:50.991189+0000","last_became_peered":"2024-09-13T17:20:50.991189+0000","last_unstale":"2024-09-13T17:25:34.845728+0000","last_undegraded":"2024-09-13T17:25:34.845728+0000","last_fullsized":"2024-09-13T17:25:34.845728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:34.845678+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:34.845678+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.845678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:33.702430+0000","scrub_duration":0.0033246199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'23","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.112478+0000","last_change":"2024-09-13T17:25:18.112726+0000","last_active":"2024-09-13T17:25:18.112478+0000","last_peered":"2024-09-13T17:25:18.112478+0000","last_clean":"2024-09-13T17:25:18.112478+0000","last_became_active":"2024-09-13T17:20:50.601498+0000","last_became_peered":"2024-09-13T17:20:50.601498+0000","last_unstale":"2024-09-13T17:25:18.112478+0000","last_undegraded":"2024-09-13T17:25:18.112478+0000","last_fullsized":"2024-09-13T17:25:18.112478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-13T17:25:18.112416+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.112416+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:20.248318+0000","scrub_duration":0.0039924269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:26:17.000602+0000","last_change":"2024-09-13T17:26:17.000856+0000","last_active":"2024-09-13T17:26:17.000602+0000","last_peered":"2024-09-13T17:26:17.000602+0000","last_clean":"2024-09-13T17:26:17.000602+0000","last_became_active":"2024-09-13T17:20:55.189609+0000","last_became_peered":"2024-09-13T17:20:55.189609+0000","last_unstale":"2024-09-13T17:26:17.000602+0000","last_undegraded":"2024-09-13T17:26:17.000602+0000","last_fullsized":"2024-09-13T17:26:17.000602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:26:17.000550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:26:17.000550+0000","last_clean_scrub_stamp":"2024-09-13T17:26:17.000550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:22.239117+0000","scrub_duration":0.0034616320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:21.165184+0000","last_change":"2024-09-13T17:25:21.165461+0000","last_active":"2024-09-13T17:25:21.165184+0000","last_peered":"2024-09-13T17:25:21.165184+0000","last_clean":"2024-09-13T17:25:21.165184+0000","last_became_active":"2024-09-13T17:20:50.949546+0000","last_became_peered":"2024-09-13T17:20:50.949546+0000","last_unstale":"2024-09-13T17:25:21.165184+0000","last_undegraded":"2024-09-13T17:25:21.165184+0000","last_fullsized":"2024-09-13T17:25:21.165184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:21.165127+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:21.165127+0000","last_clean_scrub_stamp":"2024-09-13T17:25:21.165127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:59.258109+0000","scrub_duration":0.003019346,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.386132+0000","last_change":"2024-09-13T17:25:22.386379+0000","last_active":"2024-09-13T17:25:22.386132+0000","last_peered":"2024-09-13T17:25:22.386132+0000","last_clean":"2024-09-13T17:25:22.386132+0000","last_became_active":"2024-09-13T17:20:50.605950+0000","last_became_peered":"2024-09-13T17:20:50.605950+0000","last_unstale":"2024-09-13T17:25:22.386132+0000","last_undegraded":"2024-09-13T17:25:22.386132+0000","last_fullsized":"2024-09-13T17:25:22.386132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:22.386078+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:22.386078+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.386078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:07.239770+0000","scrub_duration":0.0037360340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.687521+0000","last_change":"2024-09-13T17:25:37.687860+0000","last_active":"2024-09-13T17:25:37.687521+0000","last_peered":"2024-09-13T17:25:37.687521+0000","last_clean":"2024-09-13T17:25:37.687521+0000","last_became_active":"2024-09-13T17:20:55.185677+0000","last_became_peered":"2024-09-13T17:20:55.185677+0000","last_unstale":"2024-09-13T17:25:37.687521+0000","last_undegraded":"2024-09-13T17:25:37.687521+0000","last_fullsized":"2024-09-13T17:25:37.687521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:37.687465+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:37.687465+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.687465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:36.544217+0000","scrub_duration":0.0033668270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:37.038288+0000","last_change":"2024-09-13T17:25:37.038483+0000","last_active":"2024-09-13T17:25:37.038288+0000","last_peered":"2024-09-13T17:25:37.038288+0000","last_clean":"2024-09-13T17:25:37.038288+0000","last_became_active":"2024-09-13T17:21:32.783443+0000","last_became_peered":"2024-09-13T17:21:32.783443+0000","last_unstale":"2024-09-13T17:25:37.038288+0000","last_undegraded":"2024-09-13T17:25:37.038288+0000","last_fullsized":"2024-09-13T17:25:37.038288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:37.038236+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:37.038236+0000","last_clean_scrub_stamp":"2024-09-13T17:25:37.038236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:43.818029+0000","scrub_duration":0.0033362869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:16.154785+0000","last_change":"2024-09-13T17:25:16.154988+0000","last_active":"2024-09-13T17:25:16.154785+0000","last_peered":"2024-09-13T17:25:16.154785+0000","last_clean":"2024-09-13T17:25:16.154785+0000","last_became_active":"2024-09-13T17:20:50.575758+0000","last_became_peered":"2024-09-13T17:20:50.575758+0000","last_unstale":"2024-09-13T17:25:16.154785+0000","last_undegraded":"2024-09-13T17:25:16.154785+0000","last_fullsized":"2024-09-13T17:25:16.154785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:16.154736+0000","last_clean_scrub_stamp":"2024-09-13T17:25:16.154736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:01.008428+0000","scrub_duration":0.0028624710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.002580+0000","last_change":"2024-09-13T17:25:33.002847+0000","last_active":"2024-09-13T17:25:33.002580+0000","last_peered":"2024-09-13T17:25:33.002580+0000","last_clean":"2024-09-13T17:25:33.002580+0000","last_became_active":"2024-09-13T17:20:54.993856+0000","last_became_peered":"2024-09-13T17:20:54.993856+0000","last_unstale":"2024-09-13T17:25:33.002580+0000","last_undegraded":"2024-09-13T17:25:33.002580+0000","last_fullsized":"2024-09-13T17:25:33.002580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.002518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.002518+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.002518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:39.782311+0000","scrub_duration":0.0035369780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.168785+0000","last_change":"2024-09-13T17:25:10.169043+0000","last_active":"2024-09-13T17:25:10.168785+0000","last_peered":"2024-09-13T17:25:10.168785+0000","last_clean":"2024-09-13T17:25:10.168785+0000","last_became_active":"2024-09-13T17:20:50.973501+0000","last_became_peered":"2024-09-13T17:20:50.973501+0000","last_unstale":"2024-09-13T17:25:10.168785+0000","last_undegraded":"2024-09-13T17:25:10.168785+0000","last_fullsized":"2024-09-13T17:25:10.168785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.168724+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.168724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:49.372835+0000","scrub_duration":0.003603452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.184229+0000","last_change":"2024-09-13T17:25:18.184475+0000","last_active":"2024-09-13T17:25:18.184229+0000","last_peered":"2024-09-13T17:25:18.184229+0000","last_clean":"2024-09-13T17:25:18.184229+0000","last_became_active":"2024-09-13T17:20:50.594693+0000","last_became_peered":"2024-09-13T17:20:50.594693+0000","last_unstale":"2024-09-13T17:25:18.184229+0000","last_undegraded":"2024-09-13T17:25:18.184229+0000","last_fullsized":"2024-09-13T17:25:18.184229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:18.184172+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.184172+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:57.388284+0000","scrub_duration":0.0032424060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.005026+0000","last_change":"2024-09-13T17:25:36.005321+0000","last_active":"2024-09-13T17:25:36.005026+0000","last_peered":"2024-09-13T17:25:36.005026+0000","last_clean":"2024-09-13T17:25:36.005026+0000","last_became_active":"2024-09-13T17:20:54.991924+0000","last_became_peered":"2024-09-13T17:20:54.991924+0000","last_unstale":"2024-09-13T17:25:36.005026+0000","last_undegraded":"2024-09-13T17:25:36.005026+0000","last_fullsized":"2024-09-13T17:25:36.005026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-13T17:25:36.004968+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-13T17:25:36.004968+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.004968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:52.687137+0000","scrub_duration":0.003791296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.184865+0000","last_change":"2024-09-13T17:25:23.185129+0000","last_active":"2024-09-13T17:25:23.184865+0000","last_peered":"2024-09-13T17:25:23.184865+0000","last_clean":"2024-09-13T17:25:23.184865+0000","last_became_active":"2024-09-13T17:20:50.947754+0000","last_became_peered":"2024-09-13T17:20:50.947754+0000","last_unstale":"2024-09-13T17:25:23.184865+0000","last_undegraded":"2024-09-13T17:25:23.184865+0000","last_fullsized":"2024-09-13T17:25:23.184865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:23.184812+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:23.184812+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.184812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:06.277168+0000","scrub_duration":0.003350563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'21","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.476799+0000","last_change":"2024-09-13T17:25:07.476991+0000","last_active":"2024-09-13T17:25:07.476799+0000","last_peered":"2024-09-13T17:25:07.476799+0000","last_clean":"2024-09-13T17:25:07.476799+0000","last_became_active":"2024-09-13T17:20:50.586125+0000","last_became_peered":"2024-09-13T17:20:50.586125+0000","last_unstale":"2024-09-13T17:25:07.476799+0000","last_undegraded":"2024-09-13T17:25:07.476799+0000","last_fullsized":"2024-09-13T17:25:07.476799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-13T17:25:07.476745+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.476745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.046686+0000","scrub_duration":0.0038459200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":15,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.974688+0000","last_change":"2024-09-13T17:25:33.974929+0000","last_active":"2024-09-13T17:25:33.974688+0000","last_peered":"2024-09-13T17:25:33.974688+0000","last_clean":"2024-09-13T17:25:33.974688+0000","last_became_active":"2024-09-13T17:20:54.986309+0000","last_became_peered":"2024-09-13T17:20:54.986309+0000","last_unstale":"2024-09-13T17:25:33.974688+0000","last_undegraded":"2024-09-13T17:25:33.974688+0000","last_fullsized":"2024-09-13T17:25:33.974688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.974638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.974638+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.974638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:57.834459+0000","scrub_duration":0.003720063,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:10.646784+0000","last_change":"2024-09-13T17:25:10.647013+0000","last_active":"2024-09-13T17:25:10.646784+0000","last_peered":"2024-09-13T17:25:10.646784+0000","last_clean":"2024-09-13T17:25:10.646784+0000","last_became_active":"2024-09-13T17:20:50.974327+0000","last_became_peered":"2024-09-13T17:20:50.974327+0000","last_unstale":"2024-09-13T17:25:10.646784+0000","last_undegraded":"2024-09-13T17:25:10.646784+0000","last_fullsized":"2024-09-13T17:25:10.646784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:10.646729+0000","last_clean_scrub_stamp":"2024-09-13T17:25:10.646729+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.288029+0000","scrub_duration":0.0033289930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.383868+0000","last_change":"2024-09-13T17:25:20.384055+0000","last_active":"2024-09-13T17:25:20.383868+0000","last_peered":"2024-09-13T17:25:20.383868+0000","last_clean":"2024-09-13T17:25:20.383868+0000","last_became_active":"2024-09-13T17:20:50.610343+0000","last_became_peered":"2024-09-13T17:20:50.610343+0000","last_unstale":"2024-09-13T17:25:20.383868+0000","last_undegraded":"2024-09-13T17:25:20.383868+0000","last_fullsized":"2024-09-13T17:25:20.383868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:20.383810+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:20.383810+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.383810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:59.587921+0000","scrub_duration":0.0033592600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:32.744816+0000","last_change":"2024-09-13T17:25:32.745091+0000","last_active":"2024-09-13T17:25:32.744816+0000","last_peered":"2024-09-13T17:25:32.744816+0000","last_clean":"2024-09-13T17:25:32.744816+0000","last_became_active":"2024-09-13T17:21:33.204077+0000","last_became_peered":"2024-09-13T17:21:33.204077+0000","last_unstale":"2024-09-13T17:25:32.744816+0000","last_undegraded":"2024-09-13T17:25:32.744816+0000","last_fullsized":"2024-09-13T17:25:32.744816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:32.744765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:32.744765+0000","last_clean_scrub_stamp":"2024-09-13T17:25:32.744765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:17.662047+0000","scrub_duration":0.0034942660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.672723+0000","last_change":"2024-09-13T17:25:19.672911+0000","last_active":"2024-09-13T17:25:19.672723+0000","last_peered":"2024-09-13T17:25:19.672723+0000","last_clean":"2024-09-13T17:25:19.672723+0000","last_became_active":"2024-09-13T17:21:32.785337+0000","last_became_peered":"2024-09-13T17:21:32.785337+0000","last_unstale":"2024-09-13T17:25:19.672723+0000","last_undegraded":"2024-09-13T17:25:19.672723+0000","last_fullsized":"2024-09-13T17:25:19.672723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:19.672673+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:19.672673+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.672673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:02.765029+0000","scrub_duration":0.0034643209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.168094+0000","last_change":"2024-09-13T17:25:19.168291+0000","last_active":"2024-09-13T17:25:19.168094+0000","last_peered":"2024-09-13T17:25:19.168094+0000","last_clean":"2024-09-13T17:25:19.168094+0000","last_became_active":"2024-09-13T17:20:50.580658+0000","last_became_peered":"2024-09-13T17:20:50.580658+0000","last_unstale":"2024-09-13T17:25:19.168094+0000","last_undegraded":"2024-09-13T17:25:19.168094+0000","last_fullsized":"2024-09-13T17:25:19.168094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:19.168041+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:19.168041+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.168041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:04.021733+0000","scrub_duration":0.0032097279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:06.464996+0000","last_change":"2024-09-13T17:25:06.465209+0000","last_active":"2024-09-13T17:25:06.464996+0000","last_peered":"2024-09-13T17:25:06.464996+0000","last_clean":"2024-09-13T17:25:06.464996+0000","last_became_active":"2024-09-13T17:20:41.455811+0000","last_became_peered":"2024-09-13T17:20:41.455811+0000","last_unstale":"2024-09-13T17:25:06.464996+0000","last_undegraded":"2024-09-13T17:25:06.464996+0000","last_fullsized":"2024-09-13T17:25:06.464996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-09-13T17:25:06.464943+0000","last_clean_scrub_stamp":"2024-09-13T17:25:06.464943+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:50.219090+0000","scrub_duration":0.0095512329999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:42.695222+0000","last_change":"2024-09-13T17:25:42.695495+0000","last_active":"2024-09-13T17:25:42.695222+0000","last_peered":"2024-09-13T17:25:42.695222+0000","last_clean":"2024-09-13T17:25:42.695222+0000","last_became_active":"2024-09-13T17:20:55.190751+0000","last_became_peered":"2024-09-13T17:20:55.190751+0000","last_unstale":"2024-09-13T17:25:42.695222+0000","last_undegraded":"2024-09-13T17:25:42.695222+0000","last_fullsized":"2024-09-13T17:25:42.695222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.695164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.695164+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.695164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:06.554986+0000","scrub_duration":0.003511826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.395641+0000","last_change":"2024-09-13T17:25:29.395850+0000","last_active":"2024-09-13T17:25:29.395641+0000","last_peered":"2024-09-13T17:25:29.395641+0000","last_clean":"2024-09-13T17:25:29.395641+0000","last_became_active":"2024-09-13T17:20:50.992145+0000","last_became_peered":"2024-09-13T17:20:50.992145+0000","last_unstale":"2024-09-13T17:25:29.395641+0000","last_undegraded":"2024-09-13T17:25:29.395641+0000","last_fullsized":"2024-09-13T17:25:29.395641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:29.395585+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:29.395585+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.395585+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:12.487941+0000","scrub_duration":0.0033521530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:05.439515+0000","last_change":"2024-09-13T17:25:05.439515+0000","last_active":"2024-09-13T17:25:05.439515+0000","last_peered":"2024-09-13T17:25:05.439515+0000","last_clean":"2024-09-13T17:25:05.439515+0000","last_became_active":"2024-09-13T17:20:50.603166+0000","last_became_peered":"2024-09-13T17:20:50.603166+0000","last_unstale":"2024-09-13T17:25:05.439515+0000","last_undegraded":"2024-09-13T17:25:05.439515+0000","last_fullsized":"2024-09-13T17:25:05.439515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:05.439251+0000","last_clean_scrub_stamp":"2024-09-13T17:25:05.439251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:16.510107+0000","scrub_duration":0.003462868,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:41.719414+0000","last_change":"2024-09-13T17:25:41.719675+0000","last_active":"2024-09-13T17:25:41.719414+0000","last_peered":"2024-09-13T17:25:41.719414+0000","last_clean":"2024-09-13T17:25:41.719414+0000","last_became_active":"2024-09-13T17:20:55.187008+0000","last_became_peered":"2024-09-13T17:20:55.187008+0000","last_unstale":"2024-09-13T17:25:41.719414+0000","last_undegraded":"2024-09-13T17:25:41.719414+0000","last_fullsized":"2024-09-13T17:25:41.719414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.719357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.719357+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.719357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:48.499150+0000","scrub_duration":0.003464127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.122007+0000","last_change":"2024-09-13T17:25:04.122007+0000","last_active":"2024-09-13T17:25:04.122007+0000","last_peered":"2024-09-13T17:25:04.122007+0000","last_clean":"2024-09-13T17:25:04.122007+0000","last_became_active":"2024-09-13T17:20:50.964650+0000","last_became_peered":"2024-09-13T17:20:50.964650+0000","last_unstale":"2024-09-13T17:25:04.122007+0000","last_undegraded":"2024-09-13T17:25:04.122007+0000","last_fullsized":"2024-09-13T17:25:04.122007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:04.121755+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.121755+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:47.875902+0000","scrub_duration":0.003354901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.195677+0000","last_change":"2024-09-13T17:25:11.195677+0000","last_active":"2024-09-13T17:25:11.195677+0000","last_peered":"2024-09-13T17:25:11.195677+0000","last_clean":"2024-09-13T17:25:11.195677+0000","last_became_active":"2024-09-13T17:20:50.596331+0000","last_became_peered":"2024-09-13T17:20:50.596331+0000","last_unstale":"2024-09-13T17:25:11.195677+0000","last_undegraded":"2024-09-13T17:25:11.195677+0000","last_fullsized":"2024-09-13T17:25:11.195677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:11.195358+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.195358+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:18.836657+0000","scrub_duration":0.0067781489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.720498+0000","last_change":"2024-09-13T17:25:33.720746+0000","last_active":"2024-09-13T17:25:33.720498+0000","last_peered":"2024-09-13T17:25:33.720498+0000","last_clean":"2024-09-13T17:25:33.720498+0000","last_became_active":"2024-09-13T17:20:55.005756+0000","last_became_peered":"2024-09-13T17:20:55.005756+0000","last_unstale":"2024-09-13T17:25:33.720498+0000","last_undegraded":"2024-09-13T17:25:33.720498+0000","last_fullsized":"2024-09-13T17:25:33.720498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:33.720440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:33.720440+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.720440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:40.500232+0000","scrub_duration":0.0033947959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:39.430377+0000","last_change":"2024-09-13T17:25:39.430615+0000","last_active":"2024-09-13T17:25:39.430377+0000","last_peered":"2024-09-13T17:25:39.430377+0000","last_clean":"2024-09-13T17:25:39.430377+0000","last_became_active":"2024-09-13T17:20:50.998791+0000","last_became_peered":"2024-09-13T17:20:50.998791+0000","last_unstale":"2024-09-13T17:25:39.430377+0000","last_undegraded":"2024-09-13T17:25:39.430377+0000","last_fullsized":"2024-09-13T17:25:39.430377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:39.430316+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:39.430316+0000","last_clean_scrub_stamp":"2024-09-13T17:25:39.430316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:24.347598+0000","scrub_duration":0.003284524,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:02.438201+0000","last_change":"2024-09-13T17:25:02.438201+0000","last_active":"2024-09-13T17:25:02.438201+0000","last_peered":"2024-09-13T17:25:02.438201+0000","last_clean":"2024-09-13T17:25:02.438201+0000","last_became_active":"2024-09-13T17:20:50.586925+0000","last_became_peered":"2024-09-13T17:20:50.586925+0000","last_unstale":"2024-09-13T17:25:02.438201+0000","last_undegraded":"2024-09-13T17:25:02.438201+0000","last_fullsized":"2024-09-13T17:25:02.438201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:02.438040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:02.438040+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:16.318970+0000","scrub_duration":0.004819215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:49.065557+0000","last_change":"2024-09-13T17:25:49.065786+0000","last_active":"2024-09-13T17:25:49.065557+0000","last_peered":"2024-09-13T17:25:49.065557+0000","last_clean":"2024-09-13T17:25:49.065557+0000","last_became_active":"2024-09-13T17:20:55.190863+0000","last_became_peered":"2024-09-13T17:20:55.190863+0000","last_unstale":"2024-09-13T17:25:49.065557+0000","last_undegraded":"2024-09-13T17:25:49.065557+0000","last_fullsized":"2024-09-13T17:25:49.065557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:49.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:49.065505+0000","last_clean_scrub_stamp":"2024-09-13T17:25:49.065505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:04.612609+0000","scrub_duration":0.003721738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'6","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.496156+0000","last_change":"2024-09-13T17:25:20.496156+0000","last_active":"2024-09-13T17:25:20.496156+0000","last_peered":"2024-09-13T17:25:20.496156+0000","last_clean":"2024-09-13T17:25:20.496156+0000","last_became_active":"2024-09-13T17:21:32.723958+0000","last_became_peered":"2024-09-13T17:21:32.723958+0000","last_unstale":"2024-09-13T17:25:20.496156+0000","last_undegraded":"2024-09-13T17:25:20.496156+0000","last_fullsized":"2024-09-13T17:25:20.496156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:20.495897+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.495897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:03.053370+0000","scrub_duration":0.0035695599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.150804+0000","last_change":"2024-09-13T17:25:03.150804+0000","last_active":"2024-09-13T17:25:03.150804+0000","last_peered":"2024-09-13T17:25:03.150804+0000","last_clean":"2024-09-13T17:25:03.150804+0000","last_became_active":"2024-09-13T17:20:50.586780+0000","last_became_peered":"2024-09-13T17:20:50.586780+0000","last_unstale":"2024-09-13T17:25:03.150804+0000","last_undegraded":"2024-09-13T17:25:03.150804+0000","last_fullsized":"2024-09-13T17:25:03.150804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:03.150471+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.150471+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:57.941093+0000","scrub_duration":0.0066500159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:51.147537+0000","last_change":"2024-09-13T17:25:51.147834+0000","last_active":"2024-09-13T17:25:51.147537+0000","last_peered":"2024-09-13T17:25:51.147537+0000","last_clean":"2024-09-13T17:25:51.147537+0000","last_became_active":"2024-09-13T17:20:55.004398+0000","last_became_peered":"2024-09-13T17:20:55.004398+0000","last_unstale":"2024-09-13T17:25:51.147537+0000","last_undegraded":"2024-09-13T17:25:51.147537+0000","last_fullsized":"2024-09-13T17:25:51.147537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:51.147487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:51.147487+0000","last_clean_scrub_stamp":"2024-09-13T17:25:51.147487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:12.367687+0000","scrub_duration":0.0035323630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.356458+0000","last_change":"2024-09-13T17:25:30.356458+0000","last_active":"2024-09-13T17:25:30.356458+0000","last_peered":"2024-09-13T17:25:30.356458+0000","last_clean":"2024-09-13T17:25:30.356458+0000","last_became_active":"2024-09-13T17:20:50.990639+0000","last_became_peered":"2024-09-13T17:20:50.990639+0000","last_unstale":"2024-09-13T17:25:30.356458+0000","last_undegraded":"2024-09-13T17:25:30.356458+0000","last_fullsized":"2024-09-13T17:25:30.356458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:30.356190+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:30.356190+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.356190+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:21.089847+0000","scrub_duration":0.002950341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.415704+0000","last_change":"2024-09-13T17:25:04.415704+0000","last_active":"2024-09-13T17:25:04.415704+0000","last_peered":"2024-09-13T17:25:04.415704+0000","last_clean":"2024-09-13T17:25:04.415704+0000","last_became_active":"2024-09-13T17:20:50.581671+0000","last_became_peered":"2024-09-13T17:20:50.581671+0000","last_unstale":"2024-09-13T17:25:04.415704+0000","last_undegraded":"2024-09-13T17:25:04.415704+0000","last_fullsized":"2024-09-13T17:25:04.415704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:04.415439+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.415439+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:54.834687+0000","scrub_duration":0.0090550500000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.678670+0000","last_change":"2024-09-13T17:25:34.678670+0000","last_active":"2024-09-13T17:25:34.678670+0000","last_peered":"2024-09-13T17:25:34.678670+0000","last_clean":"2024-09-13T17:25:34.678670+0000","last_became_active":"2024-09-13T17:20:54.992283+0000","last_became_peered":"2024-09-13T17:20:54.992283+0000","last_unstale":"2024-09-13T17:25:34.678670+0000","last_undegraded":"2024-09-13T17:25:34.678670+0000","last_fullsized":"2024-09-13T17:25:34.678670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:34.678370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:34.678370+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.678370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:58.538192+0000","scrub_duration":0.003490557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.726333+0000","last_change":"2024-09-13T17:25:23.726333+0000","last_active":"2024-09-13T17:25:23.726333+0000","last_peered":"2024-09-13T17:25:23.726333+0000","last_clean":"2024-09-13T17:25:23.726333+0000","last_became_active":"2024-09-13T17:20:50.957510+0000","last_became_peered":"2024-09-13T17:20:50.957510+0000","last_unstale":"2024-09-13T17:25:23.726333+0000","last_undegraded":"2024-09-13T17:25:23.726333+0000","last_fullsized":"2024-09-13T17:25:23.726333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:23.726069+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:23.726069+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.726069+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.579760+0000","scrub_duration":0.0033541109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.731965+0000","last_change":"2024-09-13T17:25:18.731965+0000","last_active":"2024-09-13T17:25:18.731965+0000","last_peered":"2024-09-13T17:25:18.731965+0000","last_clean":"2024-09-13T17:25:18.731965+0000","last_became_active":"2024-09-13T17:20:50.610563+0000","last_became_peered":"2024-09-13T17:20:50.610563+0000","last_unstale":"2024-09-13T17:25:18.731965+0000","last_undegraded":"2024-09-13T17:25:18.731965+0000","last_fullsized":"2024-09-13T17:25:18.731965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:18.731534+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:18.731534+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.731534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:26.372834+0000","scrub_duration":0.0032596539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:26:09.942626+0000","last_change":"2024-09-13T17:26:09.942863+0000","last_active":"2024-09-13T17:26:09.942626+0000","last_peered":"2024-09-13T17:26:09.942626+0000","last_clean":"2024-09-13T17:26:09.942626+0000","last_became_active":"2024-09-13T17:20:55.185633+0000","last_became_peered":"2024-09-13T17:20:55.185633+0000","last_unstale":"2024-09-13T17:26:09.942626+0000","last_undegraded":"2024-09-13T17:26:09.942626+0000","last_fullsized":"2024-09-13T17:26:09.942626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:26:09.942575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:26:09.942575+0000","last_clean_scrub_stamp":"2024-09-13T17:26:09.942575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:49.145320+0000","scrub_duration":0.0036195099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:27.395941+0000","last_change":"2024-09-13T17:25:27.395941+0000","last_active":"2024-09-13T17:25:27.395941+0000","last_peered":"2024-09-13T17:25:27.395941+0000","last_clean":"2024-09-13T17:25:27.395941+0000","last_became_active":"2024-09-13T17:20:50.999968+0000","last_became_peered":"2024-09-13T17:20:50.999968+0000","last_unstale":"2024-09-13T17:25:27.395941+0000","last_undegraded":"2024-09-13T17:25:27.395941+0000","last_fullsized":"2024-09-13T17:25:27.395941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-13T17:25:27.395675+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-13T17:25:27.395675+0000","last_clean_scrub_stamp":"2024-09-13T17:25:27.395675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:05.488656+0000","scrub_duration":0.0030620170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.118063+0000","last_change":"2024-09-13T17:25:24.118063+0000","last_active":"2024-09-13T17:25:24.118063+0000","last_peered":"2024-09-13T17:25:24.118063+0000","last_clean":"2024-09-13T17:25:24.118063+0000","last_became_active":"2024-09-13T17:20:50.594731+0000","last_became_peered":"2024-09-13T17:20:50.594731+0000","last_unstale":"2024-09-13T17:25:24.118063+0000","last_undegraded":"2024-09-13T17:25:24.118063+0000","last_fullsized":"2024-09-13T17:25:24.118063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:24.117812+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:24.117812+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.117812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:07.420171+0000","scrub_duration":0.003376834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:26:05.884968+0000","last_change":"2024-09-13T17:26:05.885205+0000","last_active":"2024-09-13T17:26:05.884968+0000","last_peered":"2024-09-13T17:26:05.884968+0000","last_clean":"2024-09-13T17:26:05.884968+0000","last_became_active":"2024-09-13T17:20:55.185515+0000","last_became_peered":"2024-09-13T17:20:55.185515+0000","last_unstale":"2024-09-13T17:26:05.884968+0000","last_undegraded":"2024-09-13T17:26:05.884968+0000","last_fullsized":"2024-09-13T17:26:05.884968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:26:05.884914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:26:05.884914+0000","last_clean_scrub_stamp":"2024-09-13T17:26:05.884914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:28.000053+0000","scrub_duration":0.0033921200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.669681+0000","last_change":"2024-09-13T17:25:13.669681+0000","last_active":"2024-09-13T17:25:13.669681+0000","last_peered":"2024-09-13T17:25:13.669681+0000","last_clean":"2024-09-13T17:25:13.669681+0000","last_became_active":"2024-09-13T17:20:50.990320+0000","last_became_peered":"2024-09-13T17:20:50.990320+0000","last_unstale":"2024-09-13T17:25:13.669681+0000","last_undegraded":"2024-09-13T17:25:13.669681+0000","last_fullsized":"2024-09-13T17:25:13.669681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:13.669441+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.669441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:52.873552+0000","scrub_duration":0.0032794059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:24:59.611938+0000","last_change":"2024-09-13T17:24:59.611938+0000","last_active":"2024-09-13T17:24:59.611938+0000","last_peered":"2024-09-13T17:24:59.611938+0000","last_clean":"2024-09-13T17:24:59.611938+0000","last_became_active":"2024-09-13T17:20:50.596460+0000","last_became_peered":"2024-09-13T17:20:50.596460+0000","last_unstale":"2024-09-13T17:24:59.611938+0000","last_undegraded":"2024-09-13T17:24:59.611938+0000","last_fullsized":"2024-09-13T17:24:59.611938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:24:59.611848+0000","last_clean_scrub_stamp":"2024-09-13T17:24:59.611848+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:43.365995+0000","scrub_duration":0.0050935939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:50.993902+0000","last_change":"2024-09-13T17:25:50.994217+0000","last_active":"2024-09-13T17:25:50.993902+0000","last_peered":"2024-09-13T17:25:50.993902+0000","last_clean":"2024-09-13T17:25:50.993902+0000","last_became_active":"2024-09-13T17:20:55.191273+0000","last_became_peered":"2024-09-13T17:20:55.191273+0000","last_unstale":"2024-09-13T17:25:50.993902+0000","last_undegraded":"2024-09-13T17:25:50.993902+0000","last_fullsized":"2024-09-13T17:25:50.993902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:50.993851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:50.993851+0000","last_clean_scrub_stamp":"2024-09-13T17:25:50.993851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:12.214050+0000","scrub_duration":0.003473664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:43.477761+0000","last_change":"2024-09-13T17:25:43.477761+0000","last_active":"2024-09-13T17:25:43.477761+0000","last_peered":"2024-09-13T17:25:43.477761+0000","last_clean":"2024-09-13T17:25:43.477761+0000","last_became_active":"2024-09-13T17:20:50.976550+0000","last_became_peered":"2024-09-13T17:20:50.976550+0000","last_unstale":"2024-09-13T17:25:43.477761+0000","last_undegraded":"2024-09-13T17:25:43.477761+0000","last_fullsized":"2024-09-13T17:25:43.477761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:43.477448+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:43.477448+0000","last_clean_scrub_stamp":"2024-09-13T17:25:43.477448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:00.159617+0000","scrub_duration":0.0036152720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'65","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.813678+0000","last_change":"2024-09-13T17:25:09.813678+0000","last_active":"2024-09-13T17:25:09.813678+0000","last_peered":"2024-09-13T17:25:09.813678+0000","last_clean":"2024-09-13T17:25:09.813678+0000","last_became_active":"2024-09-13T17:20:50.602133+0000","last_became_peered":"2024-09-13T17:20:50.602133+0000","last_unstale":"2024-09-13T17:25:09.813678+0000","last_undegraded":"2024-09-13T17:25:09.813678+0000","last_fullsized":"2024-09-13T17:25:09.813678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-09-13T17:25:09.813409+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.813409+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:31.173392+0000","scrub_duration":0.0101034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.965596+0000","last_change":"2024-09-13T17:25:36.965596+0000","last_active":"2024-09-13T17:25:36.965596+0000","last_peered":"2024-09-13T17:25:36.965596+0000","last_clean":"2024-09-13T17:25:36.965596+0000","last_became_active":"2024-09-13T17:20:54.990576+0000","last_became_peered":"2024-09-13T17:20:54.990576+0000","last_unstale":"2024-09-13T17:25:36.965596+0000","last_undegraded":"2024-09-13T17:25:36.965596+0000","last_fullsized":"2024-09-13T17:25:36.965596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.965286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.965286+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.965286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:35.822038+0000","scrub_duration":0.0033480490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.217074+0000","last_change":"2024-09-13T17:25:19.217074+0000","last_active":"2024-09-13T17:25:19.217074+0000","last_peered":"2024-09-13T17:25:19.217074+0000","last_clean":"2024-09-13T17:25:19.217074+0000","last_became_active":"2024-09-13T17:20:50.995958+0000","last_became_peered":"2024-09-13T17:20:50.995958+0000","last_unstale":"2024-09-13T17:25:19.217074+0000","last_undegraded":"2024-09-13T17:25:19.217074+0000","last_fullsized":"2024-09-13T17:25:19.217074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-13T17:25:19.216760+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-13T17:25:19.216760+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.216760+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:41.079291+0000","scrub_duration":0.002948595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.149356+0000","last_change":"2024-09-13T17:25:19.149356+0000","last_active":"2024-09-13T17:25:19.149356+0000","last_peered":"2024-09-13T17:25:19.149356+0000","last_clean":"2024-09-13T17:25:19.149356+0000","last_became_active":"2024-09-13T17:20:50.603582+0000","last_became_peered":"2024-09-13T17:20:50.603582+0000","last_unstale":"2024-09-13T17:25:19.149356+0000","last_undegraded":"2024-09-13T17:25:19.149356+0000","last_fullsized":"2024-09-13T17:25:19.149356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:19.148940+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:19.148940+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.148940+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:41.011472+0000","scrub_duration":0.007088352,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.191338+0000","last_change":"2024-09-13T17:25:36.191338+0000","last_active":"2024-09-13T17:25:36.191338+0000","last_peered":"2024-09-13T17:25:36.191338+0000","last_clean":"2024-09-13T17:25:36.191338+0000","last_became_active":"2024-09-13T17:20:55.002439+0000","last_became_peered":"2024-09-13T17:20:55.002439+0000","last_unstale":"2024-09-13T17:25:36.191338+0000","last_undegraded":"2024-09-13T17:25:36.191338+0000","last_fullsized":"2024-09-13T17:25:36.191338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.191036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.191036+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.191036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.970828+0000","scrub_duration":0.0035775889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:19.527098+0000","last_change":"2024-09-13T17:25:19.527297+0000","last_active":"2024-09-13T17:25:19.527098+0000","last_peered":"2024-09-13T17:25:19.527098+0000","last_clean":"2024-09-13T17:25:19.527098+0000","last_became_active":"2024-09-13T17:21:32.721771+0000","last_became_peered":"2024-09-13T17:21:32.721771+0000","last_unstale":"2024-09-13T17:25:19.527098+0000","last_undegraded":"2024-09-13T17:25:19.527098+0000","last_fullsized":"2024-09-13T17:25:19.527098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:19.527040+0000","last_clean_scrub_stamp":"2024-09-13T17:25:19.527040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:23.337212+0000","scrub_duration":0.0035432609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:22.127641+0000","last_change":"2024-09-13T17:25:22.127641+0000","last_active":"2024-09-13T17:25:22.127641+0000","last_peered":"2024-09-13T17:25:22.127641+0000","last_clean":"2024-09-13T17:25:22.127641+0000","last_became_active":"2024-09-13T17:20:50.604782+0000","last_became_peered":"2024-09-13T17:20:50.604782+0000","last_unstale":"2024-09-13T17:25:22.127641+0000","last_undegraded":"2024-09-13T17:25:22.127641+0000","last_fullsized":"2024-09-13T17:25:22.127641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:22.127400+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:22.127400+0000","last_clean_scrub_stamp":"2024-09-13T17:25:22.127400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:24.263302+0000","scrub_duration":0.0030192029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:52.861250+0000","last_change":"2024-09-13T17:25:52.861482+0000","last_active":"2024-09-13T17:25:52.861250+0000","last_peered":"2024-09-13T17:25:52.861250+0000","last_clean":"2024-09-13T17:25:52.861250+0000","last_became_active":"2024-09-13T17:20:54.994018+0000","last_became_peered":"2024-09-13T17:20:54.994018+0000","last_unstale":"2024-09-13T17:25:52.861250+0000","last_undegraded":"2024-09-13T17:25:52.861250+0000","last_fullsized":"2024-09-13T17:25:52.861250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:52.861197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:52.861197+0000","last_clean_scrub_stamp":"2024-09-13T17:25:52.861197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:23.741287+0000","scrub_duration":0.0036737800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:07.088281+0000","last_change":"2024-09-13T17:25:07.088281+0000","last_active":"2024-09-13T17:25:07.088281+0000","last_peered":"2024-09-13T17:25:07.088281+0000","last_clean":"2024-09-13T17:25:07.088281+0000","last_became_active":"2024-09-13T17:20:50.995600+0000","last_became_peered":"2024-09-13T17:20:50.995600+0000","last_unstale":"2024-09-13T17:25:07.088281+0000","last_undegraded":"2024-09-13T17:25:07.088281+0000","last_fullsized":"2024-09-13T17:25:07.088281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:07.088022+0000","last_clean_scrub_stamp":"2024-09-13T17:25:07.088022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:29.108827+0000","scrub_duration":0.0031517120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:21.770806+0000","last_change":"2024-09-13T17:25:21.770806+0000","last_active":"2024-09-13T17:25:21.770806+0000","last_peered":"2024-09-13T17:25:21.770806+0000","last_clean":"2024-09-13T17:25:21.770806+0000","last_became_active":"2024-09-13T17:20:50.611452+0000","last_became_peered":"2024-09-13T17:20:50.611452+0000","last_unstale":"2024-09-13T17:25:21.770806+0000","last_undegraded":"2024-09-13T17:25:21.770806+0000","last_fullsized":"2024-09-13T17:25:21.770806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:21.770544+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:21.770544+0000","last_clean_scrub_stamp":"2024-09-13T17:25:21.770544+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:00.974655+0000","scrub_duration":0.0030705950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:54.925129+0000","last_change":"2024-09-13T17:25:54.925393+0000","last_active":"2024-09-13T17:25:54.925129+0000","last_peered":"2024-09-13T17:25:54.925129+0000","last_clean":"2024-09-13T17:25:54.925129+0000","last_became_active":"2024-09-13T17:20:55.189494+0000","last_became_peered":"2024-09-13T17:20:55.189494+0000","last_unstale":"2024-09-13T17:25:54.925129+0000","last_undegraded":"2024-09-13T17:25:54.925129+0000","last_fullsized":"2024-09-13T17:25:54.925129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:54.925075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:54.925075+0000","last_clean_scrub_stamp":"2024-09-13T17:25:54.925075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:04.961219+0000","scrub_duration":0.0036078780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.733330+0000","last_change":"2024-09-13T17:25:36.733570+0000","last_active":"2024-09-13T17:25:36.733330+0000","last_peered":"2024-09-13T17:25:36.733330+0000","last_clean":"2024-09-13T17:25:36.733330+0000","last_became_active":"2024-09-13T17:20:55.194075+0000","last_became_peered":"2024-09-13T17:20:55.194075+0000","last_unstale":"2024-09-13T17:25:36.733330+0000","last_undegraded":"2024-09-13T17:25:36.733330+0000","last_fullsized":"2024-09-13T17:25:36.733330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:36.733273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:36.733273+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.733273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:53.415442+0000","scrub_duration":0.0032446570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:00.248691+0000","last_change":"2024-09-13T17:25:00.248691+0000","last_active":"2024-09-13T17:25:00.248691+0000","last_peered":"2024-09-13T17:25:00.248691+0000","last_clean":"2024-09-13T17:25:00.248691+0000","last_became_active":"2024-09-13T17:20:50.941701+0000","last_became_peered":"2024-09-13T17:20:50.941701+0000","last_unstale":"2024-09-13T17:25:00.248691+0000","last_undegraded":"2024-09-13T17:25:00.248691+0000","last_fullsized":"2024-09-13T17:25:00.248691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:00.248535+0000","last_clean_scrub_stamp":"2024-09-13T17:25:00.248535+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:44.002682+0000","scrub_duration":0.001465844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:15.193190+0000","last_change":"2024-09-13T17:25:15.193190+0000","last_active":"2024-09-13T17:25:15.193190+0000","last_peered":"2024-09-13T17:25:15.193190+0000","last_clean":"2024-09-13T17:25:15.193190+0000","last_became_active":"2024-09-13T17:20:50.595816+0000","last_became_peered":"2024-09-13T17:20:50.595816+0000","last_unstale":"2024-09-13T17:25:15.193190+0000","last_undegraded":"2024-09-13T17:25:15.193190+0000","last_fullsized":"2024-09-13T17:25:15.193190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:15.192937+0000","last_clean_scrub_stamp":"2024-09-13T17:25:15.192937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:03.637834+0000","scrub_duration":0.0029227929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.669977+0000","last_change":"2024-09-13T17:25:40.670210+0000","last_active":"2024-09-13T17:25:40.669977+0000","last_peered":"2024-09-13T17:25:40.669977+0000","last_clean":"2024-09-13T17:25:40.669977+0000","last_became_active":"2024-09-13T17:20:54.992177+0000","last_became_peered":"2024-09-13T17:20:54.992177+0000","last_unstale":"2024-09-13T17:25:40.669977+0000","last_undegraded":"2024-09-13T17:25:40.669977+0000","last_fullsized":"2024-09-13T17:25:40.669977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:40.669925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:40.669925+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.669925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:25.587206+0000","scrub_duration":0.0035435430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.789082+0000","last_change":"2024-09-13T17:25:31.789082+0000","last_active":"2024-09-13T17:25:31.789082+0000","last_peered":"2024-09-13T17:25:31.789082+0000","last_clean":"2024-09-13T17:25:31.789082+0000","last_became_active":"2024-09-13T17:20:50.955350+0000","last_became_peered":"2024-09-13T17:20:50.955350+0000","last_unstale":"2024-09-13T17:25:31.789082+0000","last_undegraded":"2024-09-13T17:25:31.789082+0000","last_fullsized":"2024-09-13T17:25:31.789082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:31.788805+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:31.788805+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.788805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:55.648627+0000","scrub_duration":0.0031514809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.776951+0000","last_change":"2024-09-13T17:25:29.776951+0000","last_active":"2024-09-13T17:25:29.776951+0000","last_peered":"2024-09-13T17:25:29.776951+0000","last_clean":"2024-09-13T17:25:29.776951+0000","last_became_active":"2024-09-13T17:20:50.589097+0000","last_became_peered":"2024-09-13T17:20:50.589097+0000","last_unstale":"2024-09-13T17:25:29.776951+0000","last_undegraded":"2024-09-13T17:25:29.776951+0000","last_fullsized":"2024-09-13T17:25:29.776951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-13T17:25:29.776603+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-13T17:25:29.776603+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.776603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:14.693884+0000","scrub_duration":0.003380437,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:04.809132+0000","last_change":"2024-09-13T17:25:04.809132+0000","last_active":"2024-09-13T17:25:04.809132+0000","last_peered":"2024-09-13T17:25:04.809132+0000","last_clean":"2024-09-13T17:25:04.809132+0000","last_became_active":"2024-09-13T17:20:50.602253+0000","last_became_peered":"2024-09-13T17:20:50.602253+0000","last_unstale":"2024-09-13T17:25:04.809132+0000","last_undegraded":"2024-09-13T17:25:04.809132+0000","last_fullsized":"2024-09-13T17:25:04.809132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:04.808880+0000","last_clean_scrub_stamp":"2024-09-13T17:25:04.808880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:50.181093+0000","scrub_duration":0.0030294929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.724560+0000","last_change":"2024-09-13T17:25:17.724560+0000","last_active":"2024-09-13T17:25:17.724560+0000","last_peered":"2024-09-13T17:25:17.724560+0000","last_clean":"2024-09-13T17:25:17.724560+0000","last_became_active":"2024-09-13T17:20:50.975920+0000","last_became_peered":"2024-09-13T17:20:50.975920+0000","last_unstale":"2024-09-13T17:25:17.724560+0000","last_undegraded":"2024-09-13T17:25:17.724560+0000","last_fullsized":"2024-09-13T17:25:17.724560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:17.724289+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.724289+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:19.860190+0000","scrub_duration":0.003109784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:14.443046+0000","last_change":"2024-09-13T17:25:14.443046+0000","last_active":"2024-09-13T17:25:14.443046+0000","last_peered":"2024-09-13T17:25:14.443046+0000","last_clean":"2024-09-13T17:25:14.443046+0000","last_became_active":"2024-09-13T17:20:54.981261+0000","last_became_peered":"2024-09-13T17:20:54.981261+0000","last_unstale":"2024-09-13T17:25:14.443046+0000","last_undegraded":"2024-09-13T17:25:14.443046+0000","last_fullsized":"2024-09-13T17:25:14.443046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:14.442749+0000","last_clean_scrub_stamp":"2024-09-13T17:25:14.442749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:47.260752+0000","scrub_duration":0.003699786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.716975+0000","last_change":"2024-09-13T17:25:20.716975+0000","last_active":"2024-09-13T17:25:20.716975+0000","last_peered":"2024-09-13T17:25:20.716975+0000","last_clean":"2024-09-13T17:25:20.716975+0000","last_became_active":"2024-09-13T17:20:50.597691+0000","last_became_peered":"2024-09-13T17:20:50.597691+0000","last_unstale":"2024-09-13T17:25:20.716975+0000","last_undegraded":"2024-09-13T17:25:20.716975+0000","last_fullsized":"2024-09-13T17:25:20.716975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-13T17:25:20.716727+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-13T17:25:20.716727+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.716727+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:11.450383+0000","scrub_duration":0.0034162609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:12.189375+0000","last_change":"2024-09-13T17:25:12.189375+0000","last_active":"2024-09-13T17:25:12.189375+0000","last_peered":"2024-09-13T17:25:12.189375+0000","last_clean":"2024-09-13T17:25:12.189375+0000","last_became_active":"2024-09-13T17:20:50.973534+0000","last_became_peered":"2024-09-13T17:20:50.973534+0000","last_unstale":"2024-09-13T17:25:12.189375+0000","last_undegraded":"2024-09-13T17:25:12.189375+0000","last_fullsized":"2024-09-13T17:25:12.189375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:12.189124+0000","last_clean_scrub_stamp":"2024-09-13T17:25:12.189124+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:57.042815+0000","scrub_duration":0.003516005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:26:13.049387+0000","last_change":"2024-09-13T17:26:13.049625+0000","last_active":"2024-09-13T17:26:13.049387+0000","last_peered":"2024-09-13T17:26:13.049387+0000","last_clean":"2024-09-13T17:26:13.049387+0000","last_became_active":"2024-09-13T17:21:32.723085+0000","last_became_peered":"2024-09-13T17:21:32.723085+0000","last_unstale":"2024-09-13T17:26:13.049387+0000","last_undegraded":"2024-09-13T17:26:13.049387+0000","last_fullsized":"2024-09-13T17:26:13.049387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:26:13.049337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:26:13.049337+0000","last_clean_scrub_stamp":"2024-09-13T17:26:13.049337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:00.258834+0000","scrub_duration":0.0035308919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:26.762678+0000","last_change":"2024-09-13T17:25:26.762878+0000","last_active":"2024-09-13T17:25:26.762678+0000","last_peered":"2024-09-13T17:25:26.762678+0000","last_clean":"2024-09-13T17:25:26.762678+0000","last_became_active":"2024-09-13T17:20:50.969584+0000","last_became_peered":"2024-09-13T17:20:50.969584+0000","last_unstale":"2024-09-13T17:25:26.762678+0000","last_undegraded":"2024-09-13T17:25:26.762678+0000","last_fullsized":"2024-09-13T17:25:26.762678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:26.762621+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:26.762621+0000","last_clean_scrub_stamp":"2024-09-13T17:25:26.762621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:48.625153+0000","scrub_duration":0.0031858580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:09.524174+0000","last_change":"2024-09-13T17:25:09.524398+0000","last_active":"2024-09-13T17:25:09.524174+0000","last_peered":"2024-09-13T17:25:09.524174+0000","last_clean":"2024-09-13T17:25:09.524174+0000","last_became_active":"2024-09-13T17:20:50.968148+0000","last_became_peered":"2024-09-13T17:20:50.968148+0000","last_unstale":"2024-09-13T17:25:09.524174+0000","last_undegraded":"2024-09-13T17:25:09.524174+0000","last_fullsized":"2024-09-13T17:25:09.524174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:09.524113+0000","last_clean_scrub_stamp":"2024-09-13T17:25:09.524113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:20.787851+0000","scrub_duration":0.0037612919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.152064+0000","last_change":"2024-09-13T17:25:25.152262+0000","last_active":"2024-09-13T17:25:25.152064+0000","last_peered":"2024-09-13T17:25:25.152064+0000","last_clean":"2024-09-13T17:25:25.152064+0000","last_became_active":"2024-09-13T17:20:50.951192+0000","last_became_peered":"2024-09-13T17:20:50.951192+0000","last_unstale":"2024-09-13T17:25:25.152064+0000","last_undegraded":"2024-09-13T17:25:25.152064+0000","last_fullsized":"2024-09-13T17:25:25.152064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:25.152008+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:25.152008+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.152008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:03.244989+0000","scrub_duration":0.0034582440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:20.722602+0000","last_change":"2024-09-13T17:25:20.722782+0000","last_active":"2024-09-13T17:25:20.722602+0000","last_peered":"2024-09-13T17:25:20.722602+0000","last_clean":"2024-09-13T17:25:20.722602+0000","last_became_active":"2024-09-13T17:20:50.951051+0000","last_became_peered":"2024-09-13T17:20:50.951051+0000","last_unstale":"2024-09-13T17:25:20.722602+0000","last_undegraded":"2024-09-13T17:25:20.722602+0000","last_fullsized":"2024-09-13T17:25:20.722602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:20.722540+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:20.722540+0000","last_clean_scrub_stamp":"2024-09-13T17:25:20.722540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:58.815521+0000","scrub_duration":0.0028874370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:42.829926+0000","last_change":"2024-09-13T17:25:42.830113+0000","last_active":"2024-09-13T17:25:42.829926+0000","last_peered":"2024-09-13T17:25:42.829926+0000","last_clean":"2024-09-13T17:25:42.829926+0000","last_became_active":"2024-09-13T17:20:50.975255+0000","last_became_peered":"2024-09-13T17:20:50.975255+0000","last_unstale":"2024-09-13T17:25:42.829926+0000","last_undegraded":"2024-09-13T17:25:42.829926+0000","last_fullsized":"2024-09-13T17:25:42.829926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:42.829873+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:42.829873+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.829873+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:58.376976+0000","scrub_duration":0.003261987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:24.225553+0000","last_change":"2024-09-13T17:25:24.225815+0000","last_active":"2024-09-13T17:25:24.225553+0000","last_peered":"2024-09-13T17:25:24.225553+0000","last_clean":"2024-09-13T17:25:24.225553+0000","last_became_active":"2024-09-13T17:20:50.941695+0000","last_became_peered":"2024-09-13T17:20:50.941695+0000","last_unstale":"2024-09-13T17:25:24.225553+0000","last_undegraded":"2024-09-13T17:25:24.225553+0000","last_fullsized":"2024-09-13T17:25:24.225553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:24.225496+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:24.225496+0000","last_clean_scrub_stamp":"2024-09-13T17:25:24.225496+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:31.343358+0000","scrub_duration":0.0028727760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'13","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.746949+0000","last_change":"2024-09-13T17:25:31.747141+0000","last_active":"2024-09-13T17:25:31.746949+0000","last_peered":"2024-09-13T17:25:31.746949+0000","last_clean":"2024-09-13T17:25:31.746949+0000","last_became_active":"2024-09-13T17:20:50.998904+0000","last_became_peered":"2024-09-13T17:20:50.998904+0000","last_unstale":"2024-09-13T17:25:31.746949+0000","last_undegraded":"2024-09-13T17:25:31.746949+0000","last_fullsized":"2024-09-13T17:25:31.746949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-13T17:25:31.746896+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-13T17:25:31.746896+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.746896+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:22.480553+0000","scrub_duration":0.003164381,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.884549+0000","last_change":"2024-09-13T17:25:44.884812+0000","last_active":"2024-09-13T17:25:44.884549+0000","last_peered":"2024-09-13T17:25:44.884549+0000","last_clean":"2024-09-13T17:25:44.884549+0000","last_became_active":"2024-09-13T17:20:50.973998+0000","last_became_peered":"2024-09-13T17:20:50.973998+0000","last_unstale":"2024-09-13T17:25:44.884549+0000","last_undegraded":"2024-09-13T17:25:44.884549+0000","last_fullsized":"2024-09-13T17:25:44.884549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:44.884492+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:44.884492+0000","last_clean_scrub_stamp":"2024-09-13T17:25:44.884492+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:06.104691+0000","scrub_duration":0.003770963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.081177+0000","last_change":"2024-09-13T17:25:30.081421+0000","last_active":"2024-09-13T17:25:30.081177+0000","last_peered":"2024-09-13T17:25:30.081177+0000","last_clean":"2024-09-13T17:25:30.081177+0000","last_became_active":"2024-09-13T17:20:50.951074+0000","last_became_peered":"2024-09-13T17:20:50.951074+0000","last_unstale":"2024-09-13T17:25:30.081177+0000","last_undegraded":"2024-09-13T17:25:30.081177+0000","last_fullsized":"2024-09-13T17:25:30.081177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:30.081122+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:30.081122+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.081122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:20.814778+0000","scrub_duration":0.0035714520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:01.650820+0000","last_change":"2024-09-13T17:25:01.650820+0000","last_active":"2024-09-13T17:25:01.650820+0000","last_peered":"2024-09-13T17:25:01.650820+0000","last_clean":"2024-09-13T17:25:01.650820+0000","last_became_active":"2024-09-13T17:20:50.974606+0000","last_became_peered":"2024-09-13T17:20:50.974606+0000","last_unstale":"2024-09-13T17:25:01.650820+0000","last_undegraded":"2024-09-13T17:25:01.650820+0000","last_fullsized":"2024-09-13T17:25:01.650820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:01.650556+0000","last_clean_scrub_stamp":"2024-09-13T17:25:01.650556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:50.095453+0000","scrub_duration":0.0034189989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'13","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:31.033260+0000","last_change":"2024-09-13T17:25:31.033560+0000","last_active":"2024-09-13T17:25:31.033260+0000","last_peered":"2024-09-13T17:25:31.033260+0000","last_clean":"2024-09-13T17:25:31.033260+0000","last_became_active":"2024-09-13T17:20:50.992157+0000","last_became_peered":"2024-09-13T17:20:50.992157+0000","last_unstale":"2024-09-13T17:25:31.033260+0000","last_undegraded":"2024-09-13T17:25:31.033260+0000","last_fullsized":"2024-09-13T17:25:31.033260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-13T17:25:31.033156+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-13T17:25:31.033156+0000","last_clean_scrub_stamp":"2024-09-13T17:25:31.033156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:46.574034+0000","scrub_duration":0.0036197479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:28.758009+0000","last_change":"2024-09-13T17:25:28.758234+0000","last_active":"2024-09-13T17:25:28.758009+0000","last_peered":"2024-09-13T17:25:28.758009+0000","last_clean":"2024-09-13T17:25:28.758009+0000","last_became_active":"2024-09-13T17:20:50.999020+0000","last_became_peered":"2024-09-13T17:20:50.999020+0000","last_unstale":"2024-09-13T17:25:28.758009+0000","last_undegraded":"2024-09-13T17:25:28.758009+0000","last_fullsized":"2024-09-13T17:25:28.758009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:28.757955+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:28.757955+0000","last_clean_scrub_stamp":"2024-09-13T17:25:28.757955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:32.362904+0000","scrub_duration":0.0032899600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:30.771982+0000","last_change":"2024-09-13T17:25:30.772179+0000","last_active":"2024-09-13T17:25:30.771982+0000","last_peered":"2024-09-13T17:25:30.771982+0000","last_clean":"2024-09-13T17:25:30.771982+0000","last_became_active":"2024-09-13T17:20:50.987326+0000","last_became_peered":"2024-09-13T17:20:50.987326+0000","last_unstale":"2024-09-13T17:25:30.771982+0000","last_undegraded":"2024-09-13T17:25:30.771982+0000","last_fullsized":"2024-09-13T17:25:30.771982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:30.771929+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:30.771929+0000","last_clean_scrub_stamp":"2024-09-13T17:25:30.771929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:13.864285+0000","scrub_duration":0.003260836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:03.467180+0000","last_change":"2024-09-13T17:25:03.467180+0000","last_active":"2024-09-13T17:25:03.467180+0000","last_peered":"2024-09-13T17:25:03.467180+0000","last_clean":"2024-09-13T17:25:03.467180+0000","last_became_active":"2024-09-13T17:20:50.993122+0000","last_became_peered":"2024-09-13T17:20:50.993122+0000","last_unstale":"2024-09-13T17:25:03.467180+0000","last_undegraded":"2024-09-13T17:25:03.467180+0000","last_fullsized":"2024-09-13T17:25:03.467180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-13T17:25:03.466932+0000","last_clean_scrub_stamp":"2024-09-13T17:25:03.466932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:48.839144+0000","scrub_duration":0.0033368909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'12","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:11.503305+0000","last_change":"2024-09-13T17:25:11.503305+0000","last_active":"2024-09-13T17:25:11.503305+0000","last_peered":"2024-09-13T17:25:11.503305+0000","last_clean":"2024-09-13T17:25:11.503305+0000","last_became_active":"2024-09-13T17:20:50.977656+0000","last_became_peered":"2024-09-13T17:20:50.977656+0000","last_unstale":"2024-09-13T17:25:11.503305+0000","last_undegraded":"2024-09-13T17:25:11.503305+0000","last_fullsized":"2024-09-13T17:25:11.503305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-13T17:25:11.503041+0000","last_clean_scrub_stamp":"2024-09-13T17:25:11.503041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:37.249276+0000","scrub_duration":0.0030805149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.019638+0000","last_change":"2024-09-13T17:25:36.019834+0000","last_active":"2024-09-13T17:25:36.019638+0000","last_peered":"2024-09-13T17:25:36.019638+0000","last_clean":"2024-09-13T17:25:36.019638+0000","last_became_active":"2024-09-13T17:20:50.992885+0000","last_became_peered":"2024-09-13T17:20:50.992885+0000","last_unstale":"2024-09-13T17:25:36.019638+0000","last_undegraded":"2024-09-13T17:25:36.019638+0000","last_fullsized":"2024-09-13T17:25:36.019638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:36.019585+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:36.019585+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.019585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:20.936867+0000","scrub_duration":0.00303558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:34.007293+0000","last_change":"2024-09-13T17:25:34.007496+0000","last_active":"2024-09-13T17:25:34.007293+0000","last_peered":"2024-09-13T17:25:34.007293+0000","last_clean":"2024-09-13T17:25:34.007293+0000","last_became_active":"2024-09-13T17:20:50.958590+0000","last_became_peered":"2024-09-13T17:20:50.958590+0000","last_unstale":"2024-09-13T17:25:34.007293+0000","last_undegraded":"2024-09-13T17:25:34.007293+0000","last_fullsized":"2024-09-13T17:25:34.007293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-13T17:25:34.007235+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-13T17:25:34.007235+0000","last_clean_scrub_stamp":"2024-09-13T17:25:34.007235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:26.186363+0000","scrub_duration":0.0034277930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:32.040625+0000","last_change":"2024-09-13T17:25:32.040625+0000","last_active":"2024-09-13T17:25:32.040625+0000","last_peered":"2024-09-13T17:25:32.040625+0000","last_clean":"2024-09-13T17:25:32.040625+0000","last_became_active":"2024-09-13T17:20:50.974381+0000","last_became_peered":"2024-09-13T17:20:50.974381+0000","last_unstale":"2024-09-13T17:25:32.040625+0000","last_undegraded":"2024-09-13T17:25:32.040625+0000","last_fullsized":"2024-09-13T17:25:32.040625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:32.040295+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:32.040295+0000","last_clean_scrub_stamp":"2024-09-13T17:25:32.040295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:16.957576+0000","scrub_duration":0.0036150750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:18.739461+0000","last_change":"2024-09-13T17:25:18.739461+0000","last_active":"2024-09-13T17:25:18.739461+0000","last_peered":"2024-09-13T17:25:18.739461+0000","last_clean":"2024-09-13T17:25:18.739461+0000","last_became_active":"2024-09-13T17:20:50.950532+0000","last_became_peered":"2024-09-13T17:20:50.950532+0000","last_unstale":"2024-09-13T17:25:18.739461+0000","last_undegraded":"2024-09-13T17:25:18.739461+0000","last_fullsized":"2024-09-13T17:25:18.739461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:18.739141+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:18.739141+0000","last_clean_scrub_stamp":"2024-09-13T17:25:18.739141+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:40.601673+0000","scrub_duration":0.0030483250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:13.615929+0000","last_change":"2024-09-13T17:25:13.615929+0000","last_active":"2024-09-13T17:25:13.615929+0000","last_peered":"2024-09-13T17:25:13.615929+0000","last_clean":"2024-09-13T17:25:13.615929+0000","last_became_active":"2024-09-13T17:20:50.963229+0000","last_became_peered":"2024-09-13T17:20:50.963229+0000","last_unstale":"2024-09-13T17:25:13.615929+0000","last_undegraded":"2024-09-13T17:25:13.615929+0000","last_fullsized":"2024-09-13T17:25:13.615929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-13T17:25:13.615679+0000","last_clean_scrub_stamp":"2024-09-13T17:25:13.615679+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:35.478210+0000","scrub_duration":0.0034373250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:25.269523+0000","last_change":"2024-09-13T17:25:25.269523+0000","last_active":"2024-09-13T17:25:25.269523+0000","last_peered":"2024-09-13T17:25:25.269523+0000","last_clean":"2024-09-13T17:25:25.269523+0000","last_became_active":"2024-09-13T17:20:50.975047+0000","last_became_peered":"2024-09-13T17:20:50.975047+0000","last_unstale":"2024-09-13T17:25:25.269523+0000","last_undegraded":"2024-09-13T17:25:25.269523+0000","last_fullsized":"2024-09-13T17:25:25.269523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:25.269269+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:25.269269+0000","last_clean_scrub_stamp":"2024-09-13T17:25:25.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:08.361626+0000","scrub_duration":0.0031422120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:28.746464+0000","last_change":"2024-09-13T17:25:28.746464+0000","last_active":"2024-09-13T17:25:28.746464+0000","last_peered":"2024-09-13T17:25:28.746464+0000","last_clean":"2024-09-13T17:25:28.746464+0000","last_became_active":"2024-09-13T17:20:50.975274+0000","last_became_peered":"2024-09-13T17:20:50.975274+0000","last_unstale":"2024-09-13T17:25:28.746464+0000","last_undegraded":"2024-09-13T17:25:28.746464+0000","last_fullsized":"2024-09-13T17:25:28.746464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:28.746208+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:28.746208+0000","last_clean_scrub_stamp":"2024-09-13T17:25:28.746208+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:06.839190+0000","scrub_duration":0.0032046969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:36.724481+0000","last_change":"2024-09-13T17:25:36.724481+0000","last_active":"2024-09-13T17:25:36.724481+0000","last_peered":"2024-09-13T17:25:36.724481+0000","last_clean":"2024-09-13T17:25:36.724481+0000","last_became_active":"2024-09-13T17:20:50.973595+0000","last_became_peered":"2024-09-13T17:20:50.973595+0000","last_unstale":"2024-09-13T17:25:36.724481+0000","last_undegraded":"2024-09-13T17:25:36.724481+0000","last_fullsized":"2024-09-13T17:25:36.724481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-13T17:25:36.724160+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-13T17:25:36.724160+0000","last_clean_scrub_stamp":"2024-09-13T17:25:36.724160+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:40.329109+0000","scrub_duration":0.0028934709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:40.426067+0000","last_change":"2024-09-13T17:25:40.426067+0000","last_active":"2024-09-13T17:25:40.426067+0000","last_peered":"2024-09-13T17:25:40.426067+0000","last_clean":"2024-09-13T17:25:40.426067+0000","last_became_active":"2024-09-13T17:20:50.999007+0000","last_became_peered":"2024-09-13T17:20:50.999007+0000","last_unstale":"2024-09-13T17:25:40.426067+0000","last_undegraded":"2024-09-13T17:25:40.426067+0000","last_fullsized":"2024-09-13T17:25:40.426067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-13T17:25:40.425828+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-13T17:25:40.425828+0000","last_clean_scrub_stamp":"2024-09-13T17:25:40.425828+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:47.205620+0000","scrub_duration":0.0029070010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:33.804445+0000","last_change":"2024-09-13T17:25:33.804445+0000","last_active":"2024-09-13T17:25:33.804445+0000","last_peered":"2024-09-13T17:25:33.804445+0000","last_clean":"2024-09-13T17:25:33.804445+0000","last_became_active":"2024-09-13T17:20:50.952783+0000","last_became_peered":"2024-09-13T17:20:50.952783+0000","last_unstale":"2024-09-13T17:25:33.804445+0000","last_undegraded":"2024-09-13T17:25:33.804445+0000","last_fullsized":"2024-09-13T17:25:33.804445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:33.804129+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:33.804129+0000","last_clean_scrub_stamp":"2024-09-13T17:25:33.804129+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:50.486298+0000","scrub_duration":0.0035316409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:35.355677+0000","last_change":"2024-09-13T17:25:35.355677+0000","last_active":"2024-09-13T17:25:35.355677+0000","last_peered":"2024-09-13T17:25:35.355677+0000","last_clean":"2024-09-13T17:25:35.355677+0000","last_became_active":"2024-09-13T17:20:50.967355+0000","last_became_peered":"2024-09-13T17:20:50.967355+0000","last_unstale":"2024-09-13T17:25:35.355677+0000","last_undegraded":"2024-09-13T17:25:35.355677+0000","last_fullsized":"2024-09-13T17:25:35.355677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:35.355392+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:35.355392+0000","last_clean_scrub_stamp":"2024-09-13T17:25:35.355392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:38.960341+0000","scrub_duration":0.0033666540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'5","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:17.500116+0000","last_change":"2024-09-13T17:25:17.500315+0000","last_active":"2024-09-13T17:25:17.500116+0000","last_peered":"2024-09-13T17:25:17.500116+0000","last_clean":"2024-09-13T17:25:17.500116+0000","last_became_active":"2024-09-13T17:21:32.721404+0000","last_became_peered":"2024-09-13T17:21:32.721404+0000","last_unstale":"2024-09-13T17:25:17.500116+0000","last_undegraded":"2024-09-13T17:25:17.500116+0000","last_fullsized":"2024-09-13T17:25:17.500116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-13T17:25:17.500012+0000","last_clean_scrub_stamp":"2024-09-13T17:25:17.500012+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:12.784295+0000","scrub_duration":0.0029179330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.460782+0000","last_change":"2024-09-13T17:25:44.460782+0000","last_active":"2024-09-13T17:25:44.460782+0000","last_peered":"2024-09-13T17:25:44.460782+0000","last_clean":"2024-09-13T17:25:44.460782+0000","last_became_active":"2024-09-13T17:20:50.998385+0000","last_became_peered":"2024-09-13T17:20:50.998385+0000","last_unstale":"2024-09-13T17:25:44.460782+0000","last_undegraded":"2024-09-13T17:25:44.460782+0000","last_fullsized":"2024-09-13T17:25:44.460782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:44.460481+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:44.460481+0000","last_clean_scrub_stamp":"2024-09-13T17:25:44.460481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:43.317233+0000","scrub_duration":0.0032342450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:41.140236+0000","last_change":"2024-09-13T17:25:41.140523+0000","last_active":"2024-09-13T17:25:41.140236+0000","last_peered":"2024-09-13T17:25:41.140236+0000","last_clean":"2024-09-13T17:25:41.140236+0000","last_became_active":"2024-09-13T17:20:50.971516+0000","last_became_peered":"2024-09-13T17:20:50.971516+0000","last_unstale":"2024-09-13T17:25:41.140236+0000","last_undegraded":"2024-09-13T17:25:41.140236+0000","last_fullsized":"2024-09-13T17:25:41.140236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-13T17:25:41.140184+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-13T17:25:41.140184+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.140184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:39.996936+0000","scrub_duration":0.00344116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:23.720252+0000","last_change":"2024-09-13T17:25:23.720480+0000","last_active":"2024-09-13T17:25:23.720252+0000","last_peered":"2024-09-13T17:25:23.720252+0000","last_clean":"2024-09-13T17:25:23.720252+0000","last_became_active":"2024-09-13T17:20:50.950196+0000","last_became_peered":"2024-09-13T17:20:50.950196+0000","last_unstale":"2024-09-13T17:25:23.720252+0000","last_undegraded":"2024-09-13T17:25:23.720252+0000","last_fullsized":"2024-09-13T17:25:23.720252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-13T17:25:23.720199+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-13T17:25:23.720199+0000","last_clean_scrub_stamp":"2024-09-13T17:25:23.720199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:14.453855+0000","scrub_duration":0.0029025990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:29.108525+0000","last_change":"2024-09-13T17:25:29.108723+0000","last_active":"2024-09-13T17:25:29.108525+0000","last_peered":"2024-09-13T17:25:29.108525+0000","last_clean":"2024-09-13T17:25:29.108525+0000","last_became_active":"2024-09-13T17:20:50.952474+0000","last_became_peered":"2024-09-13T17:20:50.952474+0000","last_unstale":"2024-09-13T17:25:29.108525+0000","last_undegraded":"2024-09-13T17:25:29.108525+0000","last_fullsized":"2024-09-13T17:25:29.108525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-13T17:25:29.108470+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-13T17:25:29.108470+0000","last_clean_scrub_stamp":"2024-09-13T17:25:29.108470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:32.713419+0000","scrub_duration":0.0030366450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T17:25:41.443056+0000","last_change":"2024-09-13T17:25:41.443255+0000","last_active":"2024-09-13T17:25:41.443056+0000","last_peered":"2024-09-13T17:25:41.443056+0000","last_clean":"2024-09-13T17:25:41.443056+0000","last_became_active":"2024-09-13T17:20:50.998464+0000","last_became_peered":"2024-09-13T17:20:50.998464+0000","last_unstale":"2024-09-13T17:25:41.443056+0000","last_undegraded":"2024-09-13T17:25:41.443056+0000","last_fullsized":"2024-09-13T17:25:41.443056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-13T17:25:41.443004+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-13T17:25:41.443004+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.443004+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:05.302826+0000","scrub_duration":0.0028477950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":826633,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":153,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":1653266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":905216,"data_stored":715079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.80300000000000005,"15min":0.871},"min":{"1min":0.63800000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.84399999999999997,"15min":0.90800000000000003},"min":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1120000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.2050000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.82299999999999995,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.04,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.65800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.52100000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.83899999999999997},"min":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0920000000000001,"5min":1.526,"15min":1.526},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0980000000000001,"5min":1.121,"15min":1.121},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.73399999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1559999999999999,"5min":1.23,"15min":1.23},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.88400000000000001,"15min":0.92300000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1719999999999999,"5min":1.226,"15min":1.226},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.94099999999999995,"15min":0.98699999999999999},"min":{"1min":0.68500000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1299999999999999,"5min":1.365,"15min":1.365},"last":1.079}]},{"osd":5,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.93000000000000005},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.163,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.171},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.97399999999999998,"15min":0.999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1859999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.02}]},{"osd":6,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0309999999999999,"15min":1.107},"min":{"1min":0.73499999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.1870000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0069999999999999,"15min":1.012},"min":{"1min":0.75600000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2170000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.95599999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1130496,"data_stored":938939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1339999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.627,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.091,"5min":1.167,"15min":1.167},"last":0.81499999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79700000000000004,"15min":0.84099999999999997},"min":{"1min":0.70499999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.026,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.036},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.85499999999999998,"15min":0.90500000000000003},"min":{"1min":0.61099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.214,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0569999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.64300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.875},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.161,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.871,"15min":0.90200000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.153,"5min":1.615,"15min":1.615},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.88800000000000001,"15min":0.89800000000000002},"min":{"1min":0.70799999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.103,"5min":1.268,"15min":1.268},"last":0.99199999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93100000000000005,"15min":0.97399999999999998},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.1519999999999999,"5min":2.149,"15min":2.149},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":1.0149999999999999},"min":{"1min":0.745,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3540000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.93200000000000005,"15min":0.95999999999999996},"min":{"1min":0.60399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0680000000000001,"5min":1.367,"15min":1.367},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.03,"15min":1.0620000000000001},"min":{"1min":0.69999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.212,"5min":2.069,"15min":2.069},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.046,"15min":1.075},"min":{"1min":0.88600000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.286,"5min":1.964,"15min":1.964},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.753,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.258,"5min":1.619,"15min":1.619},"last":0.78200000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509511,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.83899999999999997,"15min":0.86099999999999999},"min":{"1min":0.501,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.224,"5min":1.232,"15min":1.232},"last":1.095},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82499999999999996,"15min":0.86799999999999999},"min":{"1min":0.58099999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0629999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.04}]},{"osd":1,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.80700000000000005,"15min":0.85099999999999998},"min":{"1min":0.64200000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.143,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.998},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.86399999999999999,"15min":0.87},"min":{"1min":0.61699999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.226,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84799999999999998,"15min":0.85799999999999998},"min":{"1min":0.624,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.98999999999999999,"5min":1.216,"15min":1.216},"last":1.131},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1830000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.85799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91800000000000004,"15min":0.92000000000000004},"min":{"1min":0.63800000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2130000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.97099999999999997,"15min":0.996},"min":{"1min":0.745,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3160000000000001,"5min":1.339,"15min":1.339},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.96499999999999997,"15min":0.94699999999999995},"min":{"1min":0.629,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1519999999999999,"5min":1.546,"15min":1.546},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0469999999999999,"15min":1.095},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3149999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93799999999999994},"min":{"1min":0.68899999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.0469999999999999,"5min":1.339,"15min":1.339},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.75800000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.071}]},{"osd":7,"last update":"Fri Sep 13 17:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.113,"15min":1.1539999999999999},"min":{"1min":0.70199999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0880000000000001},"min":{"1min":0.79800000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1759999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.81100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509511,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.90300000000000002},"min":{"1min":0.61499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.161,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.86699999999999999,"15min":0.92500000000000004},"min":{"1min":0.57799999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.47,"15min":1.47},"last":0.91300000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.81899999999999995,"15min":0.90300000000000002},"min":{"1min":0.54800000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.22,"5min":1.611,"15min":1.611},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77900000000000003,"15min":0.81599999999999995},"min":{"1min":0.53300000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.079,"5min":1.165,"15min":1.165},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.82199999999999995,"15min":0.876},"min":{"1min":0.55900000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.1719999999999999,"5min":1.23,"15min":1.23},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.878,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.133,"5min":1.754,"15min":1.754},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85399999999999998,"15min":0.86899999999999999},"min":{"1min":0.66200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.069,"5min":1.268,"15min":1.268},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.91500000000000004,"15min":0.98099999999999998},"min":{"1min":0.78900000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2110000000000001,"5min":1.78,"15min":1.78},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92900000000000005,"15min":0.95699999999999996},"min":{"1min":0.65700000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.212,"5min":1.694,"15min":1.694},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.995,"5min":1.0089999999999999,"15min":1.0760000000000001},"min":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1659999999999999,"5min":1.907,"15min":1.907},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.96899999999999997,"15min":1.0169999999999999},"min":{"1min":0.65900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2030000000000001,"5min":1.53,"15min":1.53},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.0369999999999999,"15min":1.095},"min":{"1min":0.755,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2849999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0109999999999999,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.272,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.073,"15min":1.1419999999999999},"min":{"1min":0.81899999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.2549999999999999,"5min":1.863,"15min":1.863},"last":0.749}]}]},{"osd":3,"up_from":15,"seq":64424509513,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1142784,"data_stored":949964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.82799999999999996,"5min":1.014,"15min":1.014},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.63600000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.80400000000000005,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.625,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.93999999999999995,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.65300000000000002},"min":{"1min":0.29399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.89500000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.1779999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67600000000000005,"15min":0.70599999999999996},"min":{"1min":0.39900000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0129999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.95299999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84999999999999998,"15min":0.89000000000000001},"min":{"1min":0.64200000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1379999999999999,"5min":1.51,"15min":1.51},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.89800000000000002,"15min":0.94099999999999995},"min":{"1min":0.72599999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1419999999999999,"5min":1.421,"15min":1.421},"last":1.1399999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.89900000000000002,"15min":0.93500000000000005},"min":{"1min":0.749,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.165,"5min":1.415,"15min":1.415},"last":1.214},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.91100000000000003,"15min":0.94099999999999995},"min":{"1min":0.57599999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5069999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.5309999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.87,"15min":0.90600000000000003},"min":{"1min":0.67700000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.127,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.04},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95399999999999996,"15min":1.0049999999999999},"min":{"1min":0.72499999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.212,"5min":1.712,"15min":1.712},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.95399999999999996,"15min":1.004},"min":{"1min":0.63400000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.446,"5min":1.756,"15min":1.756},"last":1.6040000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.93700000000000006,"15min":1},"min":{"1min":0.79900000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1559999999999999,"5min":1.946,"15min":1.946},"last":0.93700000000000006}]}]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56799999999999995,"15min":0.61699999999999999},"min":{"1min":0.27700000000000002,"5min":0.192,"15min":0.192},"max":{"1min":1.1120000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.61399999999999999,"15min":0.67400000000000004},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":1.1040000000000001,"5min":1.466,"15min":1.466},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60199999999999998,"15min":0.625},"min":{"1min":0.32400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98899999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.67300000000000004},"min":{"1min":0.28499999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.94999999999999996,"5min":1.419,"15min":1.419},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.67100000000000004,"15min":0.78500000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0740000000000001,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.075},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66500000000000004,"15min":0.72499999999999998},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2809999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.86499999999999999,"15min":0.89500000000000002},"min":{"1min":0.56599999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3009999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.85799999999999998,"15min":0.94399999999999995},"min":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2729999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.91200000000000003,"15min":0.96699999999999997},"min":{"1min":0.54000000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.621,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1},{"interface":"front","average":{"1min":1.002,"5min":0.91800000000000004,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7549999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.96099999999999997,"15min":1},"min":{"1min":0.68799999999999994,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.696,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.94999999999999996,"15min":1.0249999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.6100000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 17:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.91600000000000004,"15min":1.0129999999999999},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2070000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.002,"15min":1.0740000000000001},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.5369999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.111}]}]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":913408,"data_stored":715135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56899999999999995,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.98499999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.624},"min":{"1min":0.29199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":1,"5min":1,"15min":1},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.39500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.196,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.64600000000000002,"15min":0.67000000000000004},"min":{"1min":0.34300000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0429999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.623,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0069999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68600000000000005,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.1319999999999999,"5min":1.401,"15min":1.401},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.82899999999999996,"15min":0.875},"min":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.103,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.01},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.84799999999999998,"15min":0.88800000000000001},"min":{"1min":0.66200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.67200000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.21,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.88900000000000001,"15min":0.93899999999999995},"min":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3300000000000001,"5min":1.365,"15min":1.365},"last":0.86599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85799999999999998,"15min":0.91500000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0960000000000001,"5min":1.323,"15min":1.323},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.002,"5min":0.94099999999999995,"15min":0.997},"min":{"1min":0.748,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2609999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92900000000000005,"15min":0.99199999999999999},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.379,"5min":1.639,"15min":1.639},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92100000000000004,"15min":0.98399999999999999},"min":{"1min":0.73399999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.163,"5min":1.528,"15min":1.528},"last":0.97799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":135154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.27800000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.60699999999999998},"min":{"1min":0.436,"5min":0.255,"15min":0.255},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.624,"15min":0.65300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.026,"5min":1.075,"15min":1.075},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.90400000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.62,"15min":0.65800000000000003},"min":{"1min":0.38300000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.67900000000000005,"15min":0.73099999999999998},"min":{"1min":0.372,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.98699999999999999,"5min":1.149,"15min":1.149},"last":1.1220000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85099999999999998,"15min":0.88300000000000001},"min":{"1min":0.63900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2390000000000001,"5min":1.351,"15min":1.351},"last":1.038},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.84599999999999997,"15min":0.876},"min":{"1min":0.59499999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.1459999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.88700000000000001,"15min":0.94099999999999995},"min":{"1min":0.69999999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.88400000000000001,"15min":0.92800000000000005},"min":{"1min":0.58299999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.89000000000000001,"15min":0.92600000000000005},"min":{"1min":0.62,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.91800000000000004,"15min":0.97699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.91000000000000003,"15min":0.96399999999999997},"min":{"1min":0.78900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4179999999999999,"5min":1.554,"15min":1.554},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93500000000000005,"15min":0.97499999999999998},"min":{"1min":0.64800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.92800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":814810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:26:23.979 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T17:26:24.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.125+0000 7f02a3ade640 1 Processor -- start 2024-09-13T17:26:24.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.125+0000 7f02a3ade640 1 -- start start 2024-09-13T17:26:24.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a3ade640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f029c0996b0 0x7f029c142660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a3ade640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c142ba0 0x7f029c14c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a3ade640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0ae2a0 con 0x7f029c0992d0 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a3ade640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0b34c0 con 0x7f029c0996b0 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a3ade640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0aca10 con 0x7f029c142ba0 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a1079640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f029c0996b0 0x7f029c142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a207b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c142ba0 0x7f029c14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a1079640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f029c0996b0 0x7f029c142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.167:50420/0 (socket says 172.21.15.167:50420) 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a1079640 1 -- 172.21.15.167:0/3132096232 learned_addr learned my addr 172.21.15.167:0/3132096232 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a207b640 1 -- 172.21.15.167:0/3132096232 >> v2:172.21.15.190:3300/0 conn(0x7f029c0996b0 msgr2=0x7f029c142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:24.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a207b640 1 --2- 172.21.15.167:0/3132096232 >> v2:172.21.15.190:3300/0 conn(0x7f029c0996b0 0x7f029c142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a207b640 1 -- 172.21.15.167:0/3132096232 >> v1:172.21.15.190:6789/0 conn(0x7f029c0992d0 legacy=0x7f029c0ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a207b640 1 -- 172.21.15.167:0/3132096232 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0ad4e0 con 0x7f029c142ba0 2024-09-13T17:26:24.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.129+0000 7f02a207b640 1 --2- 172.21.15.167:0/3132096232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c142ba0 0x7f029c14c930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0294009d90 tx=0x7f029401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1221c0ae835b5231 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a0878640 1 -- 172.21.15.167:0/3132096232 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a6710 con 0x7f029c142ba0 2024-09-13T17:26:24.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a0878640 1 -- 172.21.15.167:0/3132096232 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02940a6870 con 0x7f029c142ba0 2024-09-13T17:26:24.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a0878640 1 -- 172.21.15.167:0/3132096232 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a6c00 con 0x7f029c142ba0 2024-09-13T17:26:24.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- 172.21.15.167:0/3132096232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c142ba0 msgr2=0x7f029c14c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 --2- 172.21.15.167:0/3132096232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c142ba0 0x7f029c14c930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0294009d90 tx=0x7f029401c8e0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- 172.21.15.167:0/3132096232 shutdown_connections 2024-09-13T17:26:24.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 --2- 172.21.15.167:0/3132096232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c142ba0 0x7f029c14c930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 --2- 172.21.15.167:0/3132096232 >> v2:172.21.15.190:3300/0 conn(0x7f029c0996b0 0x7f029c142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- 172.21.15.167:0/3132096232 >> 172.21.15.167:0/3132096232 conn(0x7f029c0b3b50 msgr2=0x7f029c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- 172.21.15.167:0/3132096232 shutdown_connections 2024-09-13T17:26:24.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- 172.21.15.167:0/3132096232 wait complete. 2024-09-13T17:26:24.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 Processor -- start 2024-09-13T17:26:24.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- start start 2024-09-13T17:26:24.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f029c0992d0 0x7f029c150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c0996b0 0x7f029c1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f029c142ba0 0x7f029c145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c14c8c0 con 0x7f029c142ba0 2024-09-13T17:26:24.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c14fac0 con 0x7f029c0992d0 2024-09-13T17:26:24.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c144570 con 0x7f029c0996b0 2024-09-13T17:26:24.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f029c142ba0 0x7f029c145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f029c142ba0 0x7f029c145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59536/0 (socket says 172.21.15.167:59536) 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 -- 172.21.15.167:0/2648712643 learned_addr learned my addr 172.21.15.167:0/2648712643 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a1079640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c0996b0 0x7f029c1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a187a640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f029c0992d0 0x7f029c150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 -- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c0996b0 msgr2=0x7f029c1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c0996b0 0x7f029c1450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 -- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f029c0992d0 msgr2=0x7f029c150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f029c0992d0 0x7f029c150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 -- 172.21.15.167:0/2648712643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009a70 con 0x7f029c142ba0 2024-09-13T17:26:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a207b640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f029c142ba0 0x7f029c145620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f02940b0040 tx=0x7f0294019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294007000 con 0x7f029c142ba0 2024-09-13T17:26:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02940b8630 con 0x7f029c142ba0 2024-09-13T17:26:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c143830 con 0x7f029c142ba0 2024-09-13T17:26:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940b89c0 con 0x7f029c142ba0 2024-09-13T17:26:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.133+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c143d50 con 0x7f029c142ba0 2024-09-13T17:26:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.137+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c14f920 con 0x7f029c142ba0 2024-09-13T17:26:24.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.137+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02940b8b20 con 0x7f029c142ba0 2024-09-13T17:26:24.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.137+0000 7f02927fc640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0280066690 0x7f0280068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.137+0000 7f02a187a640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0280066690 0x7f0280068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.137+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f02940aa070 con 0x7f029c142ba0 2024-09-13T17:26:24.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.137+0000 7f02a187a640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0280066690 0x7f0280068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f02980015b0 tx=0x7f0298009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.141+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f029c14f920 con 0x7f029c142ba0 2024-09-13T17:26:24.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.301+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f029c14f920 con 0x7f029c142ba0 2024-09-13T17:26:24.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.305+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f02940f0af0 con 0x7f029c142ba0 2024-09-13T17:26:24.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.305+0000 7f02927fc640 1 -- 172.21.15.167:0/2648712643 <== mon.0 v2:172.21.15.167:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f029c14f920 con 0x7f029c142ba0 2024-09-13T17:26:24.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0280066690 msgr2=0x7f0280068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0280066690 0x7f0280068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f02980015b0 tx=0x7f0298009040 comp rx=0 tx=0).stop 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f029c142ba0 msgr2=0x7f029c145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f029c142ba0 0x7f029c145620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f02940b0040 tx=0x7f0294019680 comp rx=0 tx=0).stop 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 shutdown_connections 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f0280066690 0x7f0280068b50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f029c142ba0 0x7f029c145620 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f029c0996b0 0x7f029c1450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 --2- 172.21.15.167:0/2648712643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f029c0992d0 0x7f029c150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 >> 172.21.15.167:0/2648712643 conn(0x7f029c0b3b50 msgr2=0x7f029c09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 shutdown_connections 2024-09-13T17:26:24.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.309+0000 7f02a3ade640 1 -- 172.21.15.167:0/2648712643 wait complete. 2024-09-13T17:26:24.330 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:26:24.330 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:26:24.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.441+0000 7feb53a4c640 1 Processor -- start 2024-09-13T17:26:24.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.441+0000 7feb53a4c640 1 -- start start 2024-09-13T17:26:24.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb53a4c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c06bde0 0x7feb4c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb53a4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feb4c0b6690 0x7feb4c0a0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb53a4c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c06c1c0 con 0x7feb4c06a2e0 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb53a4c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c146950 con 0x7feb4c0b6690 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb53a4c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c06b380 con 0x7feb4c06bde0 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feb4c0b6690 0x7feb4c0a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feb4c0b6690 0x7feb4c0a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59540/0 (socket says 172.21.15.167:59540) 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 -- 172.21.15.167:0/1040600921 learned_addr learned my addr 172.21.15.167:0/1040600921 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb517e8640 1 --2- 172.21.15.167:0/1040600921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c06bde0 0x7feb4c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 -- 172.21.15.167:0/1040600921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c06bde0 msgr2=0x7feb4c0b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 --2- 172.21.15.167:0/1040600921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c06bde0 0x7feb4c0b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 -- 172.21.15.167:0/1040600921 >> v1:172.21.15.190:6789/0 conn(0x7feb4c06a2e0 legacy=0x7feb4c148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 -- 172.21.15.167:0/1040600921 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c145e70 con 0x7feb4c0b6690 2024-09-13T17:26:24.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb50fe7640 1 --2- 172.21.15.167:0/1040600921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c0b6690 0x7feb4c0a0450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0bae60 tx=0x7feb3c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4441522f2824e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb43fff640 1 -- 172.21.15.167:0/1040600921 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0ab600 con 0x7feb4c0b6690 2024-09-13T17:26:24.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb43fff640 1 -- 172.21.15.167:0/1040600921 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7feb3c0ab760 con 0x7feb4c0b6690 2024-09-13T17:26:24.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.445+0000 7feb43fff640 1 -- 172.21.15.167:0/1040600921 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0abb10 con 0x7feb4c0b6690 2024-09-13T17:26:24.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/1040600921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c0b6690 msgr2=0x7feb4c0a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 --2- 172.21.15.167:0/1040600921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c0b6690 0x7feb4c0a0450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0bae60 tx=0x7feb3c01c440 comp rx=0 tx=0).stop 2024-09-13T17:26:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/1040600921 shutdown_connections 2024-09-13T17:26:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 --2- 172.21.15.167:0/1040600921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c0b6690 0x7feb4c0a0450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 --2- 172.21.15.167:0/1040600921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c06bde0 0x7feb4c0b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/1040600921 >> 172.21.15.167:0/1040600921 conn(0x7feb4c0b7e80 msgr2=0x7feb4c0b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/1040600921 shutdown_connections 2024-09-13T17:26:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/1040600921 wait complete. 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 Processor -- start 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- start start 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c06a2e0 0x7feb4c099b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb4c06bde0 0x7feb4c09f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c0b6690 0x7feb4c1e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c140d50 con 0x7feb4c06a2e0 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c09f930 con 0x7feb4c06bde0 2024-09-13T17:26:24.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c09fb80 con 0x7feb4c0b6690 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c06a2e0 0x7feb4c099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c06a2e0 0x7feb4c099b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59546/0 (socket says 172.21.15.167:59546) 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 -- 172.21.15.167:0/3721858729 learned_addr learned my addr 172.21.15.167:0/3721858729 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb51fe9640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c0b6690 0x7feb4c1e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb50fe7640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb4c06bde0 0x7feb4c09f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 -- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c0b6690 msgr2=0x7feb4c1e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c0b6690 0x7feb4c1e1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 -- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb4c06bde0 msgr2=0x7feb4c09f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb4c06bde0 0x7feb4c09f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 -- 172.21.15.167:0/3721858729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0094d0 con 0x7feb4c06a2e0 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb51fe9640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c0b6690 0x7feb4c1e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb517e8640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c06a2e0 0x7feb4c099b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb4800ce10 tx=0x7feb4800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb41ffb640 1 -- 172.21.15.167:0/3721858729 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48003ba0 con 0x7feb4c06a2e0 2024-09-13T17:26:24.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb41ffb640 1 -- 172.21.15.167:0/3721858729 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7feb48003d00 con 0x7feb4c06a2e0 2024-09-13T17:26:24.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c09fe60 con 0x7feb4c06a2e0 2024-09-13T17:26:24.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb41ffb640 1 -- 172.21.15.167:0/3721858729 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48004260 con 0x7feb4c06a2e0 2024-09-13T17:26:24.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c09e430 con 0x7feb4c06a2e0 2024-09-13T17:26:24.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.449+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c0998a0 con 0x7feb4c06a2e0 2024-09-13T17:26:24.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.453+0000 7feb41ffb640 1 -- 172.21.15.167:0/3721858729 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb480043c0 con 0x7feb4c06a2e0 2024-09-13T17:26:24.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.453+0000 7feb41ffb640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feb300666c0 0x7feb30068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.453+0000 7feb41ffb640 1 -- 172.21.15.167:0/3721858729 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7feb48012070 con 0x7feb4c06a2e0 2024-09-13T17:26:24.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.453+0000 7feb50fe7640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feb300666c0 0x7feb30068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.453+0000 7feb50fe7640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feb300666c0 0x7feb30068b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0af000 tx=0x7feb3c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.457+0000 7feb41ffb640 1 -- 172.21.15.167:0/3721858729 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb48051f90 con 0x7feb4c06a2e0 2024-09-13T17:26:24.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.633+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb4c0b6150 con 0x7feb4c06a2e0 2024-09-13T17:26:24.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb41ffb640 1 -- 172.21.15.167:0/3721858729 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3221 (secure 0 0 0) 0x7feb480555b0 con 0x7feb4c06a2e0 2024-09-13T17:26:24.639 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:26:24.639 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:21:13.609389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:26:24.640 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 8 2024-09-13T17:26:24.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feb300666c0 msgr2=0x7feb30068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feb300666c0 0x7feb30068b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0af000 tx=0x7feb3c0a7000 comp rx=0 tx=0).stop 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c06a2e0 msgr2=0x7feb4c099b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c06a2e0 0x7feb4c099b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb4800ce10 tx=0x7feb4800a660 comp rx=0 tx=0).stop 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 shutdown_connections 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7feb300666c0 0x7feb30068b80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb4c0b6690 0x7feb4c1e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb4c06bde0 0x7feb4c09f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 --2- 172.21.15.167:0/3721858729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb4c06a2e0 0x7feb4c099b80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 >> 172.21.15.167:0/3721858729 conn(0x7feb4c0b7e80 msgr2=0x7feb4c1452a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 shutdown_connections 2024-09-13T17:26:24.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.637+0000 7feb53a4c640 1 -- 172.21.15.167:0/3721858729 wait complete. 2024-09-13T17:26:24.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:26:24.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f52925e1640 1 Processor -- start 2024-09-13T17:26:24.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f52925e1640 1 -- start start 2024-09-13T17:26:24.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f52925e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f528c0b1eb0 0x7f528c0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f52925e1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f528c13f9d0 0x7f528c13fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f52925e1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0b00b0 con 0x7f528c145cb0 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f52925e1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c146100 con 0x7f528c0b1eb0 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f52925e1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c0b2290 con 0x7f528c13f9d0 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f528c0b1eb0 0x7f528c0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f528c145cb0 0x7f528c0b1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40908/0 (socket says 172.21.15.167:40908) 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528b7fe640 1 -- 172.21.15.167:0/3103165513 learned_addr learned my addr 172.21.15.167:0/3103165513 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528bfff640 1 -- 172.21.15.167:0/3103165513 >> v2:172.21.15.190:3300/0 conn(0x7f528c13f9d0 msgr2=0x7f528c13fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528bfff640 1 --2- 172.21.15.167:0/3103165513 >> v2:172.21.15.190:3300/0 conn(0x7f528c13f9d0 0x7f528c13fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528bfff640 1 -- 172.21.15.167:0/3103165513 >> v1:172.21.15.167:6789/0 conn(0x7f528c145cb0 legacy=0x7f528c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528bfff640 1 -- 172.21.15.167:0/3103165513 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c06f600 con 0x7f528c0b1eb0 2024-09-13T17:26:24.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528affd640 1 -- 172.21.15.167:0/3103165513 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336771142 0 0) 0x7f528c0b00b0 con 0x7f528c145cb0 2024-09-13T17:26:24.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528bfff640 1 --2- 172.21.15.167:0/3103165513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c0b1eb0 0x7f528c0b0540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f528c06bca0 tx=0x7f527c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86310edee4cc7d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528affd640 1 -- 172.21.15.167:0/3103165513 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c0ab600 con 0x7f528c0b1eb0 2024-09-13T17:26:24.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528affd640 1 -- 172.21.15.167:0/3103165513 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f527c0a7050 con 0x7f528c0b1eb0 2024-09-13T17:26:24.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.773+0000 7f528affd640 1 -- 172.21.15.167:0/3103165513 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c0ab9a0 con 0x7f528c0b1eb0 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- 172.21.15.167:0/3103165513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c0b1eb0 msgr2=0x7f528c0b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 --2- 172.21.15.167:0/3103165513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c0b1eb0 0x7f528c0b0540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f528c06bca0 tx=0x7f527c01c3f0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- 172.21.15.167:0/3103165513 shutdown_connections 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 --2- 172.21.15.167:0/3103165513 >> v2:172.21.15.190:3300/0 conn(0x7f528c13f9d0 0x7f528c13fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 --2- 172.21.15.167:0/3103165513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c0b1eb0 0x7f528c0b0540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- 172.21.15.167:0/3103165513 >> 172.21.15.167:0/3103165513 conn(0x7f528c0b7250 msgr2=0x7f528c0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- 172.21.15.167:0/3103165513 shutdown_connections 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- 172.21.15.167:0/3103165513 wait complete. 2024-09-13T17:26:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 Processor -- start 2024-09-13T17:26:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- start start 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f528c0b1eb0 0x7f528c1481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f528c13f9d0 0x7f528c0b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c145cb0 0x7f528c143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c147440 con 0x7f528c145cb0 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1486f0 con 0x7f528c13f9d0 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c148930 con 0x7f528c0b1eb0 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c145cb0 0x7f528c143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c145cb0 0x7f528c143c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59568/0 (socket says 172.21.15.167:59568) 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 -- 172.21.15.167:0/2164802259 learned_addr learned my addr 172.21.15.167:0/2164802259 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f528b7fe640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f528c13f9d0 0x7f528c0b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 -- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f528c0b1eb0 msgr2=0x7f528c1481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f528bfff640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f528c0b1eb0 0x7f528c1481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f528c0b1eb0 0x7f528c1481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 -- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f528c13f9d0 msgr2=0x7f528c0b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f528c13f9d0 0x7f528c0b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 -- 172.21.15.167:0/2164802259 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c009420 con 0x7f528c145cb0 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f528b7fe640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f528c13f9d0 0x7f528c0b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5290b7e640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c145cb0 0x7f528c143c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f528400db90 tx=0x7f528400dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5288ff9640 1 -- 172.21.15.167:0/2164802259 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400e980 con 0x7f528c145cb0 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5288ff9640 1 -- 172.21.15.167:0/2164802259 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f528400eb00 con 0x7f528c145cb0 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528c148c10 con 0x7f528c145cb0 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f5288ff9640 1 -- 172.21.15.167:0/2164802259 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284009580 con 0x7f528c145cb0 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.777+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528c147160 con 0x7f528c145cb0 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.781+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528c0b0520 con 0x7f528c145cb0 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.781+0000 7f5288ff9640 1 -- 172.21.15.167:0/2164802259 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52840096e0 con 0x7f528c145cb0 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.781+0000 7f5288ff9640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5278066690 0x7f5278068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.781+0000 7f5288ff9640 1 -- 172.21.15.167:0/2164802259 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5284086250 con 0x7f528c145cb0 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.781+0000 7f528bfff640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5278066690 0x7f5278068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.781+0000 7f528bfff640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5278066690 0x7f5278068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f527c0ad000 tx=0x7f527c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.785+0000 7f5288ff9640 1 -- 172.21.15.167:0/2164802259 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52840531d0 con 0x7f528c145cb0 2024-09-13T17:26:24.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f528c140f50 con 0x7f528c145cb0 2024-09-13T17:26:24.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f5288ff9640 1 -- 172.21.15.167:0/2164802259 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3221 (secure 0 0 0) 0x7f52840567f0 con 0x7f528c145cb0 2024-09-13T17:26:24.976 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:26:24.976 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3365598069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3365598069},{"type":"v1","addr":"172.21.15.190:6833","nonce":3365598069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:20:50.924847+0000","modified":"2024-09-13T17:21:13.609389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/583998386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":583998386},{"type":"v1","addr":"172.21.15.167:6835","nonce":583998386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:26:24.977 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 8 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5278066690 msgr2=0x7f5278068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5278066690 0x7f5278068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f527c0ad000 tx=0x7f527c008040 comp rx=0 tx=0).stop 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c145cb0 msgr2=0x7f528c143c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c145cb0 0x7f528c143c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f528400db90 tx=0x7f528400dc80 comp rx=0 tx=0).stop 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 shutdown_connections 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f5278066690 0x7f5278068b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f528c145cb0 0x7f528c143c80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f528c13f9d0 0x7f528c0b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 --2- 172.21.15.167:0/2164802259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f528c0b1eb0 0x7f528c1481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 >> 172.21.15.167:0/2164802259 conn(0x7f528c0b7250 msgr2=0x7f528c0ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 shutdown_connections 2024-09-13T17:26:24.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:24.973+0000 7f52925e1640 1 -- 172.21.15.167:0/2164802259 wait complete. 2024-09-13T17:26:24.995 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:26:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f69684ea640 1 Processor -- start 2024-09-13T17:26:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f69684ea640 1 -- start start 2024-09-13T17:26:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f69684ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 0x7f696014e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f69684ea640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69600b00b0 con 0x7f69600b0540 2024-09-13T17:26:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f69684ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6960146100 con 0x7f69600b1eb0 2024-09-13T17:26:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f69684ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69600b2290 con 0x7f6960145cb0 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f69600b0540 0x7f696013f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40920/0 (socket says 172.21.15.167:40920) 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 -- 172.21.15.167:0/190604375 learned_addr learned my addr 172.21.15.167:0/190604375 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857614666 0 0) 0x7f69600b00b0 con 0x7f69600b0540 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f694c003530 con 0x7f69600b0540 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6966a87640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 0x7f696014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870848547 0 0) 0x7f694c003530 con 0x7f69600b0540 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 msgr2=0x7f696014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 0x7f696014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 >> v1:172.21.15.190:6789/0 conn(0x7f69600b1eb0 legacy=0x7f69600b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696006f600 con 0x7f69600b0540 2024-09-13T17:26:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f6950001680 con 0x7f69600b0540 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 >> v1:172.21.15.167:6789/0 conn(0x7f69600b0540 legacy=0x7f696013f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 0x7f694c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f694c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f694c004d10 0x7f694c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600b2290 con 0x7f694c003fe0 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00bbd0 con 0x7f694c004d10 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00bd90 con 0x7f6960145cb0 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f694c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6966286640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 0x7f694c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6966a87640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f694c004d10 0x7f694c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 -- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 msgr2=0x7f694c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 0x7f694c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 -- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f694c004d10 msgr2=0x7f694c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f694c004d10 0x7f694c005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6965a85640 1 -- 172.21.15.167:0/190604375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c003530 con 0x7f694c003fe0 2024-09-13T17:26:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.101+0000 7f6966286640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6960145cb0 0x7f694c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:25.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6965a85640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f694c0047d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f695000c240 tx=0x7f695001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aaaa4e507b53633 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950005ae0 con 0x7f694c003fe0 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6950005c40 con 0x7f694c003fe0 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6965284640 1 -- 172.21.15.167:0/190604375 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500072d0 con 0x7f694c003fe0 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- 172.21.15.167:0/190604375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 msgr2=0x7f694c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 --2- 172.21.15.167:0/190604375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f694c0047d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f695000c240 tx=0x7f695001cc60 comp rx=0 tx=0).stop 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966a87640 1 -- 172.21.15.167:0/190604375 reap_dead start 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- 172.21.15.167:0/190604375 shutdown_connections 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- 172.21.15.167:0/190604375 >> 172.21.15.167:0/190604375 conn(0x7f69600b7250 msgr2=0x7f69600b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- 172.21.15.167:0/190604375 shutdown_connections 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- 172.21.15.167:0/190604375 wait complete. 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 Processor -- start 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- start start 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f696014b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69601e1920 0x7f69601e1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69601333c0 0x7f6960133840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960150570 con 0x7f694c003fe0 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600703a0 con 0x7f69601e1920 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f69684ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6960070680 con 0x7f69601333c0 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f696014b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f696014b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59596/0 (socket says 172.21.15.167:59596) 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 -- 172.21.15.167:0/3495254511 learned_addr learned my addr 172.21.15.167:0/3495254511 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966a87640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69601333c0 0x7f6960133840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 -- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69601333c0 msgr2=0x7f6960133840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69601333c0 0x7f6960133840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6965a85640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69601e1920 0x7f69601e1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 -- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69601e1920 msgr2=0x7f69601e1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69601e1920 0x7f69601e1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.105+0000 7f6966286640 1 -- 172.21.15.167:0/3495254511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960145930 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6966286640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f696014b410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f695c00d770 tx=0x7f695c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6956ffd640 1 -- 172.21.15.167:0/3495254511 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c005270 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6956ffd640 1 -- 172.21.15.167:0/3495254511 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f695c0053d0 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6960151570 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6956ffd640 1 -- 172.21.15.167:0/3495254511 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00b910 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6960133d80 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69601513d0 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6956ffd640 1 -- 172.21.15.167:0/3495254511 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f695c00ba70 con 0x7f694c003fe0 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6956ffd640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6944066690 0x7f6944068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6956ffd640 1 -- 172.21.15.167:0/3495254511 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f695c0844c0 con 0x7f694c003fe0 2024-09-13T17:26:25.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6965a85640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6944066690 0x7f6944068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.109+0000 7f6965a85640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6944066690 0x7f6944068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69500ab000 tx=0x7f69500a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.113+0000 7f6956ffd640 1 -- 172.21.15.167:0/3495254511 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69601513d0 con 0x7f694c003fe0 2024-09-13T17:26:25.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.261+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69601513d0 con 0x7f694c003fe0 2024-09-13T17:26:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f6956ffd640 1 -- 172.21.15.167:0/3495254511 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18815 (secure 0 0 0) 0x7f69601513d0 con 0x7f694c003fe0 2024-09-13T17:26:25.269 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-13T17:26:25.269 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":29,"fsid":"77832f00-b4f4-4330-b095-2fc2c7bace94","created":"2024-09-13T17:20:26.862967+0000","modified":"2024-09-13T17:21:32.702162+0000","last_up_change":"2024-09-13T17:20:38.267261+0000","last_in_change":"2024-09-13T17:20:29.221316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:20:39.564342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:20:49.286397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:20:49.932204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:20:52.990224+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6dc4b59-66e8-47ce-bef7-745e84b511d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6807","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6809","nonce":3243107293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6811","nonce":3243107293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6815","nonce":3243107293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3243107293},{"type":"v1","addr":"172.21.15.167:6813","nonce":3243107293}]},"public_addr":"172.21.15.167:6809/3243107293","cluster_addr":"172.21.15.167:6811/3243107293","heartbeat_back_addr":"172.21.15.167:6815/3243107293","heartbeat_front_addr":"172.21.15.167:6813/3243107293","state":["exists","up"]},{"osd":1,"uuid":"92e638ce-2e11-4362-95d0-913694724465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6801","nonce":829452776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6803","nonce":829452776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6808","nonce":829452776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":829452776},{"type":"v1","addr":"172.21.15.167:6805","nonce":829452776}]},"public_addr":"172.21.15.167:6801/829452776","cluster_addr":"172.21.15.167:6803/829452776","heartbeat_back_addr":"172.21.15.167:6808/829452776","heartbeat_front_addr":"172.21.15.167:6805/829452776","state":["exists","up"]},{"osd":2,"uuid":"a03410c0-ce29-4b7a-b100-decbc285afbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6818","nonce":3360843643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6822","nonce":3360843643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6827","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6829","nonce":3360843643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3360843643},{"type":"v1","addr":"172.21.15.167:6825","nonce":3360843643}]},"public_addr":"172.21.15.167:6818/3360843643","cluster_addr":"172.21.15.167:6822/3360843643","heartbeat_back_addr":"172.21.15.167:6829/3360843643","heartbeat_front_addr":"172.21.15.167:6825/3360843643","state":["exists","up"]},{"osd":3,"uuid":"c357ebd5-40d7-4b7b-a7b3-cd4df1443393","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6819","nonce":2142249193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6823","nonce":2142249193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6831","nonce":2142249193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2142249193},{"type":"v1","addr":"172.21.15.167:6828","nonce":2142249193}]},"public_addr":"172.21.15.167:6819/2142249193","cluster_addr":"172.21.15.167:6823/2142249193","heartbeat_back_addr":"172.21.15.167:6831/2142249193","heartbeat_front_addr":"172.21.15.167:6828/2142249193","state":["exists","up"]},{"osd":4,"uuid":"4246b7d4-5804-4f9f-aa06-344f27b85664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6811","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6813","nonce":2201043679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6815","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6816","nonce":2201043679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6823","nonce":2201043679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2201043679},{"type":"v1","addr":"172.21.15.190:6820","nonce":2201043679}]},"public_addr":"172.21.15.190:6813/2201043679","cluster_addr":"172.21.15.190:6816/2201043679","heartbeat_back_addr":"172.21.15.190:6823/2201043679","heartbeat_front_addr":"172.21.15.190:6820/2201043679","state":["exists","up"]},{"osd":5,"uuid":"df1652a6-129c-46ca-9cea-93687e8e3cc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6825","nonce":362265715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6827","nonce":362265715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6831","nonce":362265715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":362265715},{"type":"v1","addr":"172.21.15.190:6829","nonce":362265715}]},"public_addr":"172.21.15.190:6825/362265715","cluster_addr":"172.21.15.190:6827/362265715","heartbeat_back_addr":"172.21.15.190:6831/362265715","heartbeat_front_addr":"172.21.15.190:6829/362265715","state":["exists","up"]},{"osd":6,"uuid":"74655c1c-585c-4d21-99d7-66ef2600bcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6809","nonce":2566293699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6812","nonce":2566293699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6822","nonce":2566293699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2566293699},{"type":"v1","addr":"172.21.15.190:6817","nonce":2566293699}]},"public_addr":"172.21.15.190:6809/2566293699","cluster_addr":"172.21.15.190:6812/2566293699","heartbeat_back_addr":"172.21.15.190:6822/2566293699","heartbeat_front_addr":"172.21.15.190:6817/2566293699","state":["exists","up"]},{"osd":7,"uuid":"4b299b30-ef7c-45c5-ba77-14a1e74a9002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6801","nonce":1492320865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6803","nonce":1492320865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6807","nonce":1492320865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1492320865},{"type":"v1","addr":"172.21.15.190:6805","nonce":1492320865}]},"public_addr":"172.21.15.190:6801/1492320865","cluster_addr":"172.21.15.190:6803/1492320865","heartbeat_back_addr":"172.21.15.190:6807/1492320865","heartbeat_front_addr":"172.21.15.190:6805/1492320865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.551959+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.890811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.383376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.781251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.631445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.680719+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.619995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:20:34.460817+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6944066690 msgr2=0x7f6944068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6944066690 0x7f6944068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69500ab000 tx=0x7f69500a7070 comp rx=0 tx=0).stop 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 msgr2=0x7f696014b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f696014b410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f695c00d770 tx=0x7f695c00dc30 comp rx=0 tx=0).stop 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 shutdown_connections 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f6944066690 0x7f6944068b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69601333c0 0x7f6960133840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69601e1920 0x7f69601e1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 --2- 172.21.15.167:0/3495254511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c003fe0 0x7f696014b410 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 >> 172.21.15.167:0/3495254511 conn(0x7f69600b7250 msgr2=0x7f696013c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 shutdown_connections 2024-09-13T17:26:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.265+0000 7f69684ea640 1 -- 172.21.15.167:0/3495254511 wait complete. 2024-09-13T17:26:25.286 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:26:25.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14ca11f640 1 Processor -- start 2024-09-13T17:26:25.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14ca11f640 1 -- start start 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14ca11f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f14c40b6ea0 0x7f14c4148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14ca11f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f14c40bbff0 0x7f14c4142c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14ca11f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c4099370 con 0x7f14c41431c0 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14ca11f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c409a5c0 con 0x7f14c40b6ea0 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14ca11f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c409a7c0 con 0x7f14c40bbff0 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f14c40b6ea0 0x7f14c4148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f14c41431c0 0x7f14c40b7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40922/0 (socket says 172.21.15.167:40922) 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c3fff640 1 -- 172.21.15.167:0/2165461938 learned_addr learned my addr 172.21.15.167:0/2165461938 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c37fe640 1 -- 172.21.15.167:0/2165461938 >> v2:172.21.15.190:3300/0 conn(0x7f14c40bbff0 msgr2=0x7f14c4142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:25.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14bbfff640 1 --2- 172.21.15.167:0/2165461938 >> v2:172.21.15.190:3300/0 conn(0x7f14c40bbff0 0x7f14c4142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c37fe640 1 --2- 172.21.15.167:0/2165461938 >> v2:172.21.15.190:3300/0 conn(0x7f14c40bbff0 0x7f14c4142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c2ffd640 1 -- 172.21.15.167:0/2165461938 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033506481 0 0) 0x7f14c4099370 con 0x7f14c41431c0 2024-09-13T17:26:25.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c37fe640 1 -- 172.21.15.167:0/2165461938 >> v1:172.21.15.167:6789/0 conn(0x7f14c41431c0 legacy=0x7f14c40b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c37fe640 1 -- 172.21.15.167:0/2165461938 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c40b7280 con 0x7f14c40b6ea0 2024-09-13T17:26:25.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c37fe640 1 --2- 172.21.15.167:0/2165461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4148ed0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f14c4149f60 tx=0x7f14b401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402b9607da607d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c2ffd640 1 -- 172.21.15.167:0/2165461938 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40ad660 con 0x7f14c40b6ea0 2024-09-13T17:26:25.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.401+0000 7f14c2ffd640 1 -- 172.21.15.167:0/2165461938 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f14b40ad7c0 con 0x7f14c40b6ea0 2024-09-13T17:26:25.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c2ffd640 1 -- 172.21.15.167:0/2165461938 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40adb70 con 0x7f14c40b6ea0 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/2165461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 msgr2=0x7f14c4148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 --2- 172.21.15.167:0/2165461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4148ed0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f14c4149f60 tx=0x7f14b401c360 comp rx=0 tx=0).stop 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/2165461938 shutdown_connections 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 --2- 172.21.15.167:0/2165461938 >> v2:172.21.15.190:3300/0 conn(0x7f14c40bbff0 0x7f14c4142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 --2- 172.21.15.167:0/2165461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4148ed0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/2165461938 >> 172.21.15.167:0/2165461938 conn(0x7f14c4066440 msgr2=0x7f14c40bb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/2165461938 shutdown_connections 2024-09-13T17:26:25.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/2165461938 wait complete. 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 Processor -- start 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- start start 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c40bbff0 0x7f14c41e2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14c41431c0 0x7f14c41e25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c409ebf0 con 0x7f14c40b6ea0 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c409eed0 con 0x7f14c40bbff0 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c409d830 con 0x7f14c41431c0 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4142090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59620/0 (socket says 172.21.15.167:59620) 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 -- 172.21.15.167:0/63331943 learned_addr learned my addr 172.21.15.167:0/63331943 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c3fff640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14c41431c0 0x7f14c41e25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14bbfff640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c40bbff0 0x7f14c41e2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 -- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14c41431c0 msgr2=0x7f14c41e25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14c41431c0 0x7f14c41e25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 -- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c40bbff0 msgr2=0x7f14c41e2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c40bbff0 0x7f14c41e2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 -- 172.21.15.167:0/63331943 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4009420 con 0x7f14c40b6ea0 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14bbfff640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c40bbff0 0x7f14c41e2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c37fe640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4142090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f14b4018f70 tx=0x7f14b4019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c0ff9640 1 -- 172.21.15.167:0/63331943 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40b68e0 con 0x7f14c40b6ea0 2024-09-13T17:26:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c0ff9640 1 -- 172.21.15.167:0/63331943 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f14b40b6a60 con 0x7f14c40b6ea0 2024-09-13T17:26:25.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c40a0240 con 0x7f14c40b6ea0 2024-09-13T17:26:25.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14c0ff9640 1 -- 172.21.15.167:0/63331943 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40b6e30 con 0x7f14c40b6ea0 2024-09-13T17:26:25.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c409e7e0 con 0x7f14c40b6ea0 2024-09-13T17:26:25.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.405+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c41e2b00 con 0x7f14c40b6ea0 2024-09-13T17:26:25.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.409+0000 7f14c0ff9640 1 -- 172.21.15.167:0/63331943 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14b40b4040 con 0x7f14c40b6ea0 2024-09-13T17:26:25.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.409+0000 7f14c0ff9640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f14a4066690 0x7f14a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.409+0000 7f14c0ff9640 1 -- 172.21.15.167:0/63331943 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f14b411f130 con 0x7f14c40b6ea0 2024-09-13T17:26:25.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.409+0000 7f14bbfff640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f14a4066690 0x7f14a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.409+0000 7f14bbfff640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f14a4066690 0x7f14a4068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f14ac006fd0 tx=0x7f14ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.413+0000 7f14c0ff9640 1 -- 172.21.15.167:0/63331943 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f14b40ec150 con 0x7f14c40b6ea0 2024-09-13T17:26:25.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.589+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14c409ed30 con 0x7f14c40b6ea0 2024-09-13T17:26:25.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.621+0000 7f14c0ff9640 1 -- 172.21.15.167:0/63331943 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14c409ed30 con 0x7f14c40b6ea0 2024-09-13T17:26:25.625 INFO:teuthology.orchestra.run.smithi167.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:26:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f14a4066690 msgr2=0x7f14a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f14a4066690 0x7f14a4068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f14ac006fd0 tx=0x7f14ac008040 comp rx=0 tx=0).stop 2024-09-13T17:26:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 msgr2=0x7f14c4142090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4142090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f14b4018f70 tx=0x7f14b4019100 comp rx=0 tx=0).stop 2024-09-13T17:26:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 shutdown_connections 2024-09-13T17:26:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f14a4066690 0x7f14a4068b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14c41431c0 0x7f14c41e25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14c40bbff0 0x7f14c41e2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 --2- 172.21.15.167:0/63331943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40b6ea0 0x7f14c4142090 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 >> 172.21.15.167:0/63331943 conn(0x7f14c4066440 msgr2=0x7f14c4143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 shutdown_connections 2024-09-13T17:26:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.625+0000 7f14ca11f640 1 -- 172.21.15.167:0/63331943 wait complete. 2024-09-13T17:26:25.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:26:25.711 INFO:tasks.ceph.mds.a.smithi167.stdout:starting mds.a at 2024-09-13T17:26:25.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f4588428640 1 Processor -- start 2024-09-13T17:26:25.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f4588428640 1 -- start start 2024-09-13T17:26:25.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f4588428640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f45801433d0 0x7f45800b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f4588428640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800aef60 con 0x7f45800710a0 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f4588428640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800b0710 con 0x7f4580065ee0 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f4588428640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800b1130 con 0x7f45801433d0 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45859c3640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f45800710a0 0x7f458014c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40936/0 (socket says 172.21.15.167:40936) 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45859c3640 1 -- 172.21.15.167:0/3416568143 learned_addr learned my addr 172.21.15.167:0/3416568143 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480901926 0 0) 0x7f45800aef60 con 0x7f45800710a0 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f456c003530 con 0x7f45800710a0 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45869c5640 1 --2- 172.21.15.167:0/3416568143 >> v2:172.21.15.190:3300/0 conn(0x7f45801433d0 0x7f45800b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254388383 0 0) 0x7f456c003530 con 0x7f45800710a0 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 >> v2:172.21.15.190:3300/0 conn(0x7f45801433d0 msgr2=0x7f45800b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 --2- 172.21.15.167:0/3416568143 >> v2:172.21.15.190:3300/0 conn(0x7f45801433d0 0x7f45800b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 >> v1:172.21.15.190:6789/0 conn(0x7f4580065ee0 legacy=0x7f4580142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800662c0 con 0x7f45800710a0 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f4570001680 con 0x7f45800710a0 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 >> v1:172.21.15.167:6789/0 conn(0x7f45800710a0 legacy=0x7f458014c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f456c003980 0x7f456c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f456c0047d0 0x7f456c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c0052b0 0x7f456c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c00c150 con 0x7f456c003980 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c00c2c0 con 0x7f456c0047d0 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c00c480 con 0x7f456c0052b0 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45861c4640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f456c003980 0x7f456c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45859c3640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f456c0047d0 0x7f456c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45869c5640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c0052b0 0x7f456c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45861c4640 1 -- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c0052b0 msgr2=0x7f456c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45861c4640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c0052b0 0x7f456c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45861c4640 1 -- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f456c0047d0 msgr2=0x7f456c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45861c4640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f456c0047d0 0x7f456c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45861c4640 1 -- 172.21.15.167:0/3416568143 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c003530 con 0x7f456c003980 2024-09-13T17:26:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.757+0000 7f45869c5640 1 -- 172.21.15.167:0/3416568143 reap_dead start 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45861c4640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f456c003980 0x7f456c003da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4578001e40 tx=0x7f457801c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b61e28d813c5054 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578003b80 con 0x7f456c003980 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4578003ce0 con 0x7f456c003980 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45851c2640 1 -- 172.21.15.167:0/3416568143 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578005330 con 0x7f456c003980 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- 172.21.15.167:0/3416568143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f456c003980 msgr2=0x7f456c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f456c003980 0x7f456c003da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4578001e40 tx=0x7f457801c6f0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- 172.21.15.167:0/3416568143 shutdown_connections 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 --2- 172.21.15.167:0/3416568143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f456c003980 0x7f456c003da0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- 172.21.15.167:0/3416568143 >> 172.21.15.167:0/3416568143 conn(0x7f45800b5960 msgr2=0x7f45800b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- 172.21.15.167:0/3416568143 shutdown_connections 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- 172.21.15.167:0/3416568143 wait complete. 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 Processor -- start 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- start start 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c003980 0x7f45801dd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45800ad9b0 0x7f45800b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45800acb90 0x7f458013eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800addd0 con 0x7f45800acb90 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800ad010 con 0x7f45800ad9b0 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f4588428640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458011ff30 con 0x7f456c003980 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45800acb90 0x7f458013eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45800acb90 0x7f458013eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59674/0 (socket says 172.21.15.167:59674) 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 -- 172.21.15.167:0/3409406018 learned_addr learned my addr 172.21.15.167:0/3409406018 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45861c4640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c003980 0x7f45801dd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45859c3640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45800ad9b0 0x7f45800b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 -- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c003980 msgr2=0x7f45801dd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c003980 0x7f45801dd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 -- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45800ad9b0 msgr2=0x7f45800b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45800ad9b0 0x7f45800b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 -- 172.21.15.167:0/3409406018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800ad200 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45859c3640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45800ad9b0 0x7f45800b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.761+0000 7f45869c5640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45800acb90 0x7f458013eb40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4580071ce0 tx=0x7f457c00e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4576ffd640 1 -- 172.21.15.167:0/3409406018 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00c070 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4576ffd640 1 -- 172.21.15.167:0/3409406018 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f457c013610 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45800ac390 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4576ffd640 1 -- 172.21.15.167:0/3409406018 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0139e0 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45800adfe0 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45801430d0 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4576ffd640 1 -- 172.21.15.167:0/3409406018 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f457c013b40 con 0x7f45800acb90 2024-09-13T17:26:25.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4576ffd640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f45640666c0 0x7f4564068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:25.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f45861c4640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f45640666c0 0x7f4564068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:25.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f4576ffd640 1 -- 172.21.15.167:0/3409406018 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f457c083da0 con 0x7f45800acb90 2024-09-13T17:26:25.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.765+0000 7f45861c4640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f45640666c0 0x7f4564068b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45780ac000 tx=0x7f4578001520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:25.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.769+0000 7f4576ffd640 1 -- 172.21.15.167:0/3409406018 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f457c050c50 con 0x7f45800acb90 2024-09-13T17:26:25.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:25.945+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45800ac840 con 0x7f45800acb90 2024-09-13T17:26:26.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.621+0000 7f4576ffd640 1 -- 172.21.15.167:0/3409406018 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f457c054270 con 0x7f45800acb90 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f45640666c0 msgr2=0x7f4564068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f45640666c0 0x7f4564068b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45780ac000 tx=0x7f4578001520 comp rx=0 tx=0).stop 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45800acb90 msgr2=0x7f458013eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45800acb90 0x7f458013eb40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4580071ce0 tx=0x7f457c00e8b0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 shutdown_connections 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f45640666c0 0x7f4564068b80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45800acb90 0x7f458013eb40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45800ad9b0 0x7f45800b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 --2- 172.21.15.167:0/3409406018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f456c003980 0x7f45801dd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 >> 172.21.15.167:0/3409406018 conn(0x7f45800b5960 msgr2=0x7f4580140d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:26.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 shutdown_connections 2024-09-13T17:26:26.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.625+0000 7f4588428640 1 -- 172.21.15.167:0/3409406018 wait complete. 2024-09-13T17:26:26.650 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:26:26.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e02a61640 1 Processor -- start 2024-09-13T17:26:26.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e02a61640 1 -- start start 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e02a61640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3dfc142950 0x7f3dfc142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e02a61640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc0ad160 con 0x7f3dfc0b4540 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e02a61640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc0b4920 con 0x7f3dfc0b2d40 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e02a61640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc0ae690 con 0x7f3dfc142950 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3dfc0b4540 0x7f3dfc0aed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40950/0 (socket says 172.21.15.167:40950) 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 -- 172.21.15.167:0/4233885883 learned_addr learned my addr 172.21.15.167:0/4233885883 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428456251 0 0) 0x7f3dfc0ad160 con 0x7f3dfc0b4540 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de4003530 con 0x7f3dfc0b4540 2024-09-13T17:26:26.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e00ffe640 1 --2- 172.21.15.167:0/4233885883 >> v2:172.21.15.190:3300/0 conn(0x7f3dfc142950 0x7f3dfc142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1174817010 0 0) 0x7f3de4003530 con 0x7f3dfc0b4540 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 >> v2:172.21.15.190:3300/0 conn(0x7f3dfc142950 msgr2=0x7f3dfc142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 --2- 172.21.15.167:0/4233885883 >> v2:172.21.15.190:3300/0 conn(0x7f3dfc142950 0x7f3dfc142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 >> v1:172.21.15.190:6789/0 conn(0x7f3dfc0b2d40 legacy=0x7f3dfc0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc0b3df0 con 0x7f3dfc0b4540 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1139937770 0 0) 0x7f3df0001680 con 0x7f3dfc0b4540 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 >> v1:172.21.15.167:6789/0 conn(0x7f3dfc0b4540 legacy=0x7f3dfc0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4003980 0x7f3de4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de40047d0 0x7f3de4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de4005190 0x7f3de400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0ae690 con 0x7f3de4003980 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de400c0c0 con 0x7f3de4005190 2024-09-13T17:26:26.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de400c280 con 0x7f3de40047d0 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4003980 0x7f3de4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfb7fe640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de40047d0 0x7f3de4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e00ffe640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de4005190 0x7f3de400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 -- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de40047d0 msgr2=0x7f3de4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de40047d0 0x7f3de4004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 -- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de4005190 msgr2=0x7f3de400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de4005190 0x7f3de400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3dfbfff640 1 -- 172.21.15.167:0/4233885883 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4003530 con 0x7f3de4003980 2024-09-13T17:26:26.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.773+0000 7f3e00ffe640 1 -- 172.21.15.167:0/4233885883 reap_dead start 2024-09-13T17:26:26.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3dfbfff640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4003980 0x7f3de4003d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c190 tx=0x7f3df001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94878f18cd6b8c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00a5af0 con 0x7f3de4003980 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3df00a5c50 con 0x7f3de4003980 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3dfaffd640 1 -- 172.21.15.167:0/4233885883 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00058e0 con 0x7f3de4003980 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 -- 172.21.15.167:0/4233885883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4003980 msgr2=0x7f3de4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4003980 0x7f3de4003d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c190 tx=0x7f3df001cc10 comp rx=0 tx=0).stop 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 -- 172.21.15.167:0/4233885883 shutdown_connections 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 --2- 172.21.15.167:0/4233885883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4003980 0x7f3de4003d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 -- 172.21.15.167:0/4233885883 >> 172.21.15.167:0/4233885883 conn(0x7f3dfc0b4c40 msgr2=0x7f3dfc0b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 -- 172.21.15.167:0/4233885883 shutdown_connections 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 -- 172.21.15.167:0/4233885883 wait complete. 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 Processor -- start 2024-09-13T17:26:26.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.777+0000 7f3e02a61640 1 -- start start 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de4003980 0x7f3dfc09d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dfc09d670 0x7f3dfc147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dfc147640 0x7f3dfc1407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc09dd50 con 0x7f3dfc09d670 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc147ac0 con 0x7f3dfc147640 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc09c0d0 con 0x7f3de4003980 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dfc09d670 0x7f3dfc147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dfc09d670 0x7f3dfc147100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59688/0 (socket says 172.21.15.167:59688) 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 -- 172.21.15.167:0/3770973698 learned_addr learned my addr 172.21.15.167:0/3770973698 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:26.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfbfff640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de4003980 0x7f3dfc09d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 -- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de4003980 msgr2=0x7f3dfc09d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de4003980 0x7f3dfc09d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 -- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dfc147640 msgr2=0x7f3dfc1407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e00ffe640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dfc147640 0x7f3dfc1407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dfc147640 0x7f3dfc1407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 -- 172.21.15.167:0/3770973698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc09c3b0 con 0x7f3dfc09d670 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfb7fe640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dfc09d670 0x7f3dfc147100 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00d4f0 tx=0x7f3dec00d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3df8ff9640 1 -- 172.21.15.167:0/3770973698 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec012800 con 0x7f3dfc09d670 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3df8ff9640 1 -- 172.21.15.167:0/3770973698 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3dec012960 con 0x7f3dfc09d670 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc09cb00 con 0x7f3dfc09d670 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3df8ff9640 1 -- 172.21.15.167:0/3770973698 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec012d30 con 0x7f3dfc09d670 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc148b70 con 0x7f3dfc09d670 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc09c5f0 con 0x7f3dfc09d670 2024-09-13T17:26:26.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3df8ff9640 1 -- 172.21.15.167:0/3770973698 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3dec023350 con 0x7f3dfc09d670 2024-09-13T17:26:26.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3df8ff9640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3de8066690 0x7f3de8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:26.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfbfff640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3de8066690 0x7f3de8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:26.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3df8ff9640 1 -- 172.21.15.167:0/3770973698 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f3dec084610 con 0x7f3dfc09d670 2024-09-13T17:26:26.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.781+0000 7f3dfbfff640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3de8066690 0x7f3de8068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3df00ab000 tx=0x7f3df0006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:26.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.785+0000 7f3df8ff9640 1 -- 172.21.15.167:0/3770973698 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3dec0515e0 con 0x7f3dfc09d670 2024-09-13T17:26:26.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:26.945+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3dfc146db0 con 0x7f3dfc09d670 2024-09-13T17:26:27.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.773+0000 7f3df8ff9640 1 -- 172.21.15.167:0/3770973698 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3dec054c00 con 0x7f3dfc09d670 2024-09-13T17:26:27.783 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.781+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3de8066690 msgr2=0x7f3de8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.781+0000 7f3e02a61640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3de8066690 0x7f3de8068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3df00ab000 tx=0x7f3df0006040 comp rx=0 tx=0).stop 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dfc09d670 msgr2=0x7f3dfc147100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dfc09d670 0x7f3dfc147100 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00d4f0 tx=0x7f3dec00d9b0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 shutdown_connections 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f3de8066690 0x7f3de8068b50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dfc147640 0x7f3dfc1407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dfc09d670 0x7f3dfc147100 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 --2- 172.21.15.167:0/3770973698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3de4003980 0x7f3dfc09d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 >> 172.21.15.167:0/3770973698 conn(0x7f3dfc0b4c40 msgr2=0x7f3dfc145ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:27.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 shutdown_connections 2024-09-13T17:26:27.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.785+0000 7f3e02a61640 1 -- 172.21.15.167:0/3770973698 wait complete. 2024-09-13T17:26:27.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:26:27.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 Processor -- start 2024-09-13T17:26:27.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 -- start start 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 0x7fc5bc145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5bc06a830 0x7fc5bc099f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc5bc09aa60 0x7fc5bc09a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc0b6c40 con 0x7fc5bc06a830 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc06a3a0 con 0x7fc5bc09aa60 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5c0dc7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc145fd0 con 0x7fc5bc0bada0 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5bc06a830 0x7fc5bc099f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5bc06a830 0x7fc5bc099f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48454/0 (socket says 172.21.15.167:48454) 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 -- 172.21.15.167:0/1018049634 learned_addr learned my addr 172.21.15.167:0/1018049634 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5ba59c640 1 --2- 172.21.15.167:0/1018049634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 0x7fc5bc145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:27.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5bad9d640 1 --2- 172.21.15.167:0/1018049634 >> v2:172.21.15.190:3300/0 conn(0x7fc5bc09aa60 0x7fc5bc09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:27.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 -- 172.21.15.167:0/1018049634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 msgr2=0x7fc5bc145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:27.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 --2- 172.21.15.167:0/1018049634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 0x7fc5bc145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 -- 172.21.15.167:0/1018049634 >> v2:172.21.15.190:3300/0 conn(0x7fc5bc09aa60 msgr2=0x7fc5bc09a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:27.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 --2- 172.21.15.167:0/1018049634 >> v2:172.21.15.190:3300/0 conn(0x7fc5bc09aa60 0x7fc5bc09a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.937+0000 7fc5b9d9b640 1 -- 172.21.15.167:0/1018049634 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0bb180 con 0x7fc5bc06a830 2024-09-13T17:26:27.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5b9d9b640 1 --2- 172.21.15.167:0/1018049634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc099f40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0bb370 tx=0x7fc5b001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d041940dc1bdecb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:27.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5b959a640 1 -- 172.21.15.167:0/1018049634 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00ab670 con 0x7fc5bc06a830 2024-09-13T17:26:27.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5b959a640 1 -- 172.21.15.167:0/1018049634 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5b00ab7d0 con 0x7fc5bc06a830 2024-09-13T17:26:27.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5b959a640 1 -- 172.21.15.167:0/1018049634 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00abb80 con 0x7fc5bc06a830 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/1018049634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 msgr2=0x7fc5bc099f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/1018049634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc099f40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0bb370 tx=0x7fc5b001c490 comp rx=0 tx=0).stop 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/1018049634 shutdown_connections 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/1018049634 >> v2:172.21.15.190:3300/0 conn(0x7fc5bc09aa60 0x7fc5bc09a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/1018049634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc099f40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/1018049634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 0x7fc5bc145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/1018049634 >> 172.21.15.167:0/1018049634 conn(0x7fc5bc0b7e40 msgr2=0x7fc5bc0b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/1018049634 shutdown_connections 2024-09-13T17:26:27.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/1018049634 wait complete. 2024-09-13T17:26:27.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 Processor -- start 2024-09-13T17:26:27.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- start start 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc1e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5bc09aa60 0x7fc5bc0a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 0x7fc5bc0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0b11a0 con 0x7fc5bc06a830 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0b04a0 con 0x7fc5bc09aa60 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5c0dc7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0b0e00 con 0x7fc5bc0bada0 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5ba59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc1e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5ba59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc1e0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48464/0 (socket says 172.21.15.167:48464) 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5ba59c640 1 -- 172.21.15.167:0/4195110018 learned_addr learned my addr 172.21.15.167:0/4195110018 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5b9d9b640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5bc09aa60 0x7fc5bc0a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5ba59c640 1 -- 172.21.15.167:0/4195110018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 msgr2=0x7fc5bc0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:27.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5ba59c640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 0x7fc5bc0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5ba59c640 1 -- 172.21.15.167:0/4195110018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5bc09aa60 msgr2=0x7fc5bc0a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.941+0000 7fc5ba59c640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5bc09aa60 0x7fc5bc0a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5ba59c640 1 -- 172.21.15.167:0/4195110018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00094d0 con 0x7fc5bc06a830 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5ba59c640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc1e0ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00d5f0 tx=0x7fc5ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5aaffd640 1 -- 172.21.15.167:0/4195110018 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac0125f0 con 0x7fc5bc06a830 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5aaffd640 1 -- 172.21.15.167:0/4195110018 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5ac012750 con 0x7fc5bc06a830 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc1431e0 con 0x7fc5bc06a830 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5aaffd640 1 -- 172.21.15.167:0/4195110018 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac012b00 con 0x7fc5bc06a830 2024-09-13T17:26:27.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc0b1df0 con 0x7fc5bc06a830 2024-09-13T17:26:27.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc1428e0 con 0x7fc5bc06a830 2024-09-13T17:26:27.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5aaffd640 1 -- 172.21.15.167:0/4195110018 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5ac012c60 con 0x7fc5bc06a830 2024-09-13T17:26:27.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5aaffd640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc59c0666c0 0x7fc59c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:27.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5b9d9b640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc59c0666c0 0x7fc59c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:27.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5aaffd640 1 -- 172.21.15.167:0/4195110018 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6340+0+0 (secure 0 0 0) 0x7fc5ac084760 con 0x7fc5bc06a830 2024-09-13T17:26:27.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.945+0000 7fc5b9d9b640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc59c0666c0 0x7fc59c068b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00af000 tx=0x7fc5b00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:27.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:27.949+0000 7fc5aaffd640 1 -- 172.21.15.167:0/4195110018 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5ac0518e0 con 0x7fc5bc06a830 2024-09-13T17:26:28.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.109+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc5bc149c20 con 0x7fc5bc06a830 2024-09-13T17:26:28.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.781+0000 7fc5aaffd640 1 -- 172.21.15.167:0/4195110018 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc5ac054f00 con 0x7fc5bc06a830 2024-09-13T17:26:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data' removed 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc59c0666c0 msgr2=0x7fc59c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc59c0666c0 0x7fc59c068b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00af000 tx=0x7fc5b00a7000 comp rx=0 tx=0).stop 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 msgr2=0x7fc5bc1e0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc1e0ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00d5f0 tx=0x7fc5ac00dab0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 shutdown_connections 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7fc59c0666c0 0x7fc59c068b80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5bc0bada0 0x7fc5bc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5bc09aa60 0x7fc5bc0a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 --2- 172.21.15.167:0/4195110018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5bc06a830 0x7fc5bc1e0ec0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 >> 172.21.15.167:0/4195110018 conn(0x7fc5bc0b7e40 msgr2=0x7fc5bc0b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:28.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 shutdown_connections 2024-09-13T17:26:28.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.789+0000 7fc5c0dc7640 1 -- 172.21.15.167:0/4195110018 wait complete. 2024-09-13T17:26:28.818 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T17:26:28.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f1270a86640 1 Processor -- start 2024-09-13T17:26:28.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f1270a86640 1 -- start start 2024-09-13T17:26:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f1270a86640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f126c098a40 0x7f126c143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f1270a86640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f126c143fe0 0x7f126c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f1270a86640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c144490 con 0x7f126c0b3530 2024-09-13T17:26:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f1270a86640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c09b090 con 0x7f126c143fe0 2024-09-13T17:26:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f1270a86640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c09d410 con 0x7f126c098a40 2024-09-13T17:26:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f126c143fe0 0x7f126c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f126c143fe0 0x7f126c14dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48472/0 (socket says 172.21.15.167:48472) 2024-09-13T17:26:28.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126a59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f126c0b3530 0x7f126c09cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39888/0 (socket says 172.21.15.167:39888) 2024-09-13T17:26:28.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126ad9d640 1 -- 172.21.15.167:0/3484013226 learned_addr learned my addr 172.21.15.167:0/3484013226 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:28.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126ad9d640 1 -- 172.21.15.167:0/3484013226 >> v2:172.21.15.190:3300/0 conn(0x7f126c098a40 msgr2=0x7f126c143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:28.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126ad9d640 1 --2- 172.21.15.167:0/3484013226 >> v2:172.21.15.190:3300/0 conn(0x7f126c098a40 0x7f126c143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126ad9d640 1 -- 172.21.15.167:0/3484013226 >> v1:172.21.15.167:6789/0 conn(0x7f126c0b3530 legacy=0x7f126c09cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:28.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126ad9d640 1 -- 172.21.15.167:0/3484013226 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0b3910 con 0x7f126c143fe0 2024-09-13T17:26:28.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.937+0000 7f126959a640 1 -- 172.21.15.167:0/3484013226 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678696403 0 0) 0x7f126c144490 con 0x7f126c0b3530 2024-09-13T17:26:28.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f126ad9d640 1 --2- 172.21.15.167:0/3484013226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c14dff0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f126c06c6e0 tx=0x7f126401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f97eb5cdf5d0f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:28.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f126959a640 1 -- 172.21.15.167:0/3484013226 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a58b0 con 0x7f126c143fe0 2024-09-13T17:26:28.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f126959a640 1 -- 172.21.15.167:0/3484013226 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f12640a5a10 con 0x7f126c143fe0 2024-09-13T17:26:28.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f126959a640 1 -- 172.21.15.167:0/3484013226 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a5dc0 con 0x7f126c143fe0 2024-09-13T17:26:28.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- 172.21.15.167:0/3484013226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 msgr2=0x7f126c14dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:28.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 --2- 172.21.15.167:0/3484013226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c14dff0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f126c06c6e0 tx=0x7f126401c9f0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- 172.21.15.167:0/3484013226 shutdown_connections 2024-09-13T17:26:28.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 --2- 172.21.15.167:0/3484013226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c14dff0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 --2- 172.21.15.167:0/3484013226 >> v2:172.21.15.190:3300/0 conn(0x7f126c098a40 0x7f126c143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- 172.21.15.167:0/3484013226 >> 172.21.15.167:0/3484013226 conn(0x7f126c0b3b50 msgr2=0x7f126c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:28.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- 172.21.15.167:0/3484013226 shutdown_connections 2024-09-13T17:26:28.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- 172.21.15.167:0/3484013226 wait complete. 2024-09-13T17:26:28.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 Processor -- start 2024-09-13T17:26:28.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- start start 2024-09-13T17:26:28.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f126c0b3530 0x7f126c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:28.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c1dc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:28.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f126c144ff0 0x7f126c1dc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:28.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1dbd60 con 0x7f126c143fe0 2024-09-13T17:26:28.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0716e0 con 0x7f126c0b3530 2024-09-13T17:26:28.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c145540 con 0x7f126c144ff0 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c1dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c1dc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48474/0 (socket says 172.21.15.167:48474) 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 -- 172.21.15.167:0/302936556 learned_addr learned my addr 172.21.15.167:0/302936556 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f126a59c640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f126c0b3530 0x7f126c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 -- 172.21.15.167:0/302936556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f126c144ff0 msgr2=0x7f126c1dc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f126c144ff0 0x7f126c1dc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 -- 172.21.15.167:0/302936556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f126c0b3530 msgr2=0x7f126c0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:28.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f126c0b3530 0x7f126c0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:28.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 -- 172.21.15.167:0/302936556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009b30 con 0x7f126c143fe0 2024-09-13T17:26:28.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1269d9b640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c1dc180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f125c00b550 tx=0x7f125c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:28.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1262ffd640 1 -- 172.21.15.167:0/302936556 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c010870 con 0x7f126c143fe0 2024-09-13T17:26:28.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1262ffd640 1 -- 172.21.15.167:0/302936556 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f125c0109f0 con 0x7f126c143fe0 2024-09-13T17:26:28.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c071400 con 0x7f126c143fe0 2024-09-13T17:26:28.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1262ffd640 1 -- 172.21.15.167:0/302936556 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c010dc0 con 0x7f126c143fe0 2024-09-13T17:26:28.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.941+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c071020 con 0x7f126c143fe0 2024-09-13T17:26:28.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.945+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c1dbac0 con 0x7f126c143fe0 2024-09-13T17:26:28.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.945+0000 7f1262ffd640 1 -- 172.21.15.167:0/302936556 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f125c00f3c0 con 0x7f126c143fe0 2024-09-13T17:26:28.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.945+0000 7f1262ffd640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f124c066690 0x7f124c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:28.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.945+0000 7f1262ffd640 1 -- 172.21.15.167:0/302936556 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f125c084290 con 0x7f126c143fe0 2024-09-13T17:26:28.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.945+0000 7f126a59c640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f124c066690 0x7f124c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:28.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.945+0000 7f126a59c640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f124c066690 0x7f124c068b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1254000f70 tx=0x7f1254009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:28.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:28.949+0000 7f1262ffd640 1 -- 172.21.15.167:0/302936556 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f126c1dbac0 con 0x7f126c143fe0 2024-09-13T17:26:29.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.117+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f126c1dbea0 con 0x7f126c143fe0 2024-09-13T17:26:29.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.797+0000 7f1262ffd640 1 -- 172.21.15.167:0/302936556 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f126c1dbea0 con 0x7f126c143fe0 2024-09-13T17:26:29.803 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data_ec' removed 2024-09-13T17:26:29.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f124c066690 msgr2=0x7f124c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:29.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f124c066690 0x7f124c068b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1254000f70 tx=0x7f1254009040 comp rx=0 tx=0).stop 2024-09-13T17:26:29.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 msgr2=0x7f126c1dc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:29.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c1dc180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f125c00b550 tx=0x7f125c00ba10 comp rx=0 tx=0).stop 2024-09-13T17:26:29.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 shutdown_connections 2024-09-13T17:26:29.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:6832/1477469698,v1:172.21.15.167:6833/1477469698] conn(0x7f124c066690 0x7f124c068b50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:29.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f126c144ff0 0x7f126c1dc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:29.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c143fe0 0x7f126c1dc180 secure :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f125c00b550 tx=0x7f125c00ba10 comp rx=0 tx=0).stop 2024-09-13T17:26:29.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 --2- 172.21.15.167:0/302936556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f126c0b3530 0x7f126c0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:29.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 >> 172.21.15.167:0/302936556 conn(0x7f126c0b3b50 msgr2=0x7f126c06b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:29.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 shutdown_connections 2024-09-13T17:26:29.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-13T17:26:29.805+0000 7f1270a86640 1 -- 172.21.15.167:0/302936556 wait complete. 2024-09-13T17:26:29.834 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T17:26:29.834 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:26:29.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:29.846 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:26:29.847 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:26:29.847 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:29.861 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:26:29.861 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T17:26:29.862 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T17:26:29.862 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:35.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T17:26:35.963 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T17:26:35.964 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T17:26:35.964 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.023 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T17:26:36.023 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T17:26:36.023 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.093 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T17:26:36.093 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T17:26:36.093 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.170 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T17:26:36.170 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T17:26:36.171 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.236 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T17:26:36.236 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T17:26:36.236 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.312 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T17:26:36.313 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T17:26:36.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.389 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T17:26:36.389 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T17:26:36.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.462 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T17:26:36.462 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T17:26:36.462 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T17:26:36.462 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.492 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T17:26:36.492 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T17:26:36.492 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.521 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T17:26:36.521 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T17:26:36.521 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T17:26:36.521 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.557 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T17:26:36.557 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T17:26:36.557 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.580 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T17:26:36.580 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T17:26:36.580 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:36.637 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T17:26:36.637 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T17:26:36.637 DEBUG:teuthology.orchestra.run.smithi167:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T17:26:36.680 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:26:36.680 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T17:26:37.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:26:37.033 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T17:26:37.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:26:37.174 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T17:26:37.290 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:26:37.291 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T17:26:37.425 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:26:37.426 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T17:26:37.817 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:26:37.817 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T17:26:37.956 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:26:37.956 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T17:26:38.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:26:38.117 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T17:26:38.264 INFO:tasks.ceph:Archiving mon data... 2024-09-13T17:26:38.265 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/data/mon.a.tgz 2024-09-13T17:26:38.266 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-13T17:26:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.X1oksM6F7F 2024-09-13T17:26:38.286 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.X1oksM6F7F 2024-09-13T17:26:38.431 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.X1oksM6F7F 2024-09-13T17:26:38.517 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.X1oksM6F7F is 316KB 2024-09-13T17:26:38.577 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.X1oksM6F7F 2024-09-13T17:26:38.582 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/data/mon.b.tgz 2024-09-13T17:26:38.583 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-09-13T17:26:38.588 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.DyDW3Bv0Gh 2024-09-13T17:26:38.589 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DyDW3Bv0Gh 2024-09-13T17:26:38.735 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.DyDW3Bv0Gh 2024-09-13T17:26:38.798 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.DyDW3Bv0Gh is 416KB 2024-09-13T17:26:38.856 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.DyDW3Bv0Gh 2024-09-13T17:26:38.861 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/data/mon.c.tgz 2024-09-13T17:26:38.861 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-09-13T17:26:38.906 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.AeDhKrPYCs 2024-09-13T17:26:38.907 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AeDhKrPYCs 2024-09-13T17:26:39.048 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.AeDhKrPYCs 2024-09-13T17:26:39.110 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.AeDhKrPYCs is 416KB 2024-09-13T17:26:39.128 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.AeDhKrPYCs 2024-09-13T17:26:39.133 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T17:26:39.133 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:26:39.136 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:26:39.190 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T17:26:39.190 DEBUG:teuthology.orchestra.run.smithi167:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:26:39.200 DEBUG:teuthology.orchestra.run.smithi190:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:26:39.221 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:26:39.260 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:26:39.262 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T17:26:39.263 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/remote/smithi167/crash 2024-09-13T17:26:39.264 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:26:39.277 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/remote/smithi190/crash 2024-09-13T17:26:39.278 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:26:39.315 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T17:26:39.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:39.324 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:39.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:39.419 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:39.460 INFO:tasks.ceph:Compressing logs... 2024-09-13T17:26:39.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:26:39.464 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:26:40.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T17:26:44.309 INFO:tasks.ceph:Archiving logs... 2024-09-13T17:26:44.309 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/remote/smithi167/log 2024-09-13T17:26:44.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:26:44.919 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/remote/smithi190/log 2024-09-13T17:26:44.920 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:26:45.346 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:26:45.358 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:26:45.358 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:26:45.360 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:26:45.453 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:26:45.464 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:26:45.464 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:26:45.467 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:26:45.479 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:26:45.479 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-09-13T17:26:45.479 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 67.205.162.81 3 u 46 64 377 0.098 -1.791 1.009 2024-09-13T17:26:45.479 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 377 0.081 -2.064 1.318 2024-09-13T17:26:45.479 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.078 -2.095 1.362 2024-09-13T17:26:45.479 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:26:45.532 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:26:45.532 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2024-09-13T17:26:45.532 INFO:teuthology.orchestra.run.smithi167.stdout:+hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.064 -1.758 1.126 2024-09-13T17:26:45.532 INFO:teuthology.orchestra.run.smithi167.stdout:*hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.096 -1.109 1.263 2024-09-13T17:26:45.532 INFO:teuthology.orchestra.run.smithi167.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.082 -0.198 0.734 2024-09-13T17:26:45.533 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:26:45.534 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:26:45.545 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:26:45.546 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:26:45.702 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:26:45.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:26:45.788 INFO:teuthology.task.internal:Duration was 1021.660656 seconds 2024-09-13T17:26:45.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:26:45.856 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:26:45.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:26:45.863 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:26:46.028 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:26:46.028 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-13T17:26:46.029 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:26:46.044 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-09-13T17:26:46.045 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:26:46.056 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:26:46.057 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:26:46.092 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:26:46.192 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:26:46.193 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:26:46.195 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:26:46.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:26:46.636 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:26:46.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:26:46.665 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:26:46.679 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:26:46.765 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:26:46.768 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:26:46.780 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-09-13T17:26:46.796 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-13T17:26:46.891 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:26:46.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:26:46.896 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:26:46.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:26:46.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:26:46.953 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:26:46.954 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/remote/smithi167 2024-09-13T17:26:46.954 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:26:46.977 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903879/remote/smithi190 2024-09-13T17:26:46.978 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:26:47.002 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:26:47.002 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:26:47.016 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:26:47.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:26:47.075 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:26:47.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:26:47.138 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:26:47.139 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:26:47.142 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:26:47.146 INFO:teuthology.orchestra.run.smithi167.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:26 /home/ubuntu/cephtest 2024-09-13T17:26:47.148 INFO:teuthology.orchestra.run.smithi190.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:26 /home/ubuntu/cephtest 2024-09-13T17:26:47.150 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:26:47.178 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:26:47.352 INFO:teuthology.run:Summary data: description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} duration: 1021.6606559753418 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:26:47.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:26:47.448 INFO:teuthology.run:pass